-- Logs begin at Tue 2022-05-03 20:17:02 UTC, end at Tue 2022-05-03 21:47:57 UTC. -- May 03 21:18:53.299516 dv-cinder-840377-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 03 21:18:53.308349 dv-cinder-840377-1-iscsi devstack@n-api.service[83312]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 03 21:18:53.310397 dv-cinder-840377-1-iscsi devstack@n-api.service[83312]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 3 21:18:53 2022] *** May 03 21:18:53.310397 dv-cinder-840377-1-iscsi devstack@n-api.service[83312]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 03 21:18:53.310397 dv-cinder-840377-1-iscsi devstack@n-api.service[83312]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 03 21:18:53.310397 dv-cinder-840377-1-iscsi devstack@n-api.service[83312]: nodename: dv-cinder-840377-1-iscsi May 03 21:18:53.310397 dv-cinder-840377-1-iscsi devstack@n-api.service[83312]: machine: x86_64 May 03 21:18:53.310397 dv-cinder-840377-1-iscsi devstack@n-api.service[83312]: clock source: unix May 03 21:18:53.310397 dv-cinder-840377-1-iscsi devstack@n-api.service[83312]: pcre jit disabled May 03 21:18:53.310397 dv-cinder-840377-1-iscsi devstack@n-api.service[83312]: detected number of CPU cores: 4 May 03 21:18:53.310397 dv-cinder-840377-1-iscsi devstack@n-api.service[83312]: current working directory: / May 03 21:18:53.310957 dv-cinder-840377-1-iscsi devstack@n-api.service[83312]: detected binary path: /usr/bin/uwsgi-core May 03 21:18:53.310957 dv-cinder-840377-1-iscsi devstack@n-api.service[83312]: your processes number limit is 47680 May 03 21:18:53.310957 dv-cinder-840377-1-iscsi devstack@n-api.service[83312]: your memory page size is 4096 bytes May 03 21:18:53.310957 dv-cinder-840377-1-iscsi devstack@n-api.service[83312]: detected max file descriptor number: 2048 May 03 21:18:53.310957 dv-cinder-840377-1-iscsi devstack@n-api.service[83312]: lock engine: pthread robust mutexes May 03 21:18:53.310957 dv-cinder-840377-1-iscsi devstack@n-api.service[83312]: thunder lock: enabled May 03 21:18:53.310957 dv-cinder-840377-1-iscsi devstack@n-api.service[83312]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 03 21:18:53.310957 dv-cinder-840377-1-iscsi devstack@n-api.service[83312]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 03 21:18:53.351633 dv-cinder-840377-1-iscsi devstack@n-api.service[83312]: Python main interpreter initialized at 0x558929fa89c0 May 03 21:18:53.351633 dv-cinder-840377-1-iscsi devstack@n-api.service[83312]: python threads support enabled May 03 21:18:53.351633 dv-cinder-840377-1-iscsi devstack@n-api.service[83312]: your server socket listen backlog is limited to 100 connections May 03 21:18:53.351633 dv-cinder-840377-1-iscsi devstack@n-api.service[83312]: your mercy for graceful operations on workers is 90 seconds May 03 21:18:53.351972 dv-cinder-840377-1-iscsi devstack@n-api.service[83312]: mapped 403077 bytes (393 KB) for 2 cores May 03 21:18:53.352060 dv-cinder-840377-1-iscsi devstack@n-api.service[83312]: *** Operational MODE: preforking *** May 03 21:18:53.352289 dv-cinder-840377-1-iscsi devstack@n-api.service[83312]: *** uWSGI is running in multiple interpreter mode *** May 03 21:18:53.352289 dv-cinder-840377-1-iscsi devstack@n-api.service[83312]: spawned uWSGI master process (pid: 83312) May 03 21:18:53.352510 dv-cinder-840377-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 03 21:18:53.355259 dv-cinder-840377-1-iscsi devstack@n-api.service[83312]: spawned uWSGI worker 1 (pid: 83313, cores: 1) May 03 21:18:53.355259 dv-cinder-840377-1-iscsi devstack@n-api.service[83312]: spawned uWSGI worker 2 (pid: 83314, cores: 1) May 03 21:18:53.355259 dv-cinder-840377-1-iscsi devstack@n-api.service[83312]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 03 21:18:57.450748 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 03 21:18:57.451458 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 03 21:18:57.451458 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 03 21:18:57.451729 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 03 21:18:57.451969 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 03 21:18:57.452345 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.452696 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.453044 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] bandwidth_poll_interval = 600 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.453377 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] bindir = /usr/local/bin {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.453693 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.454128 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.454402 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.454598 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.454908 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.455228 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.455579 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.455856 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.456091 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.456406 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840377-1-iscsi {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.456738 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.457037 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.457364 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.457778 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.457994 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.458261 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.458595 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.459041 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.459471 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.459773 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.460078 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.460404 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.460735 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.461038 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.461276 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 03 21:18:57.461668 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.461739 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 03 21:18:57.461812 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.461964 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.462056 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 03 21:18:57.462240 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.462345 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 03 21:18:57.462552 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840377-1-iscsi {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.462665 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 03 21:18:57.462862 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.463015 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.463167 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.463256 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.463470 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.463556 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] bandwidth_poll_interval = 600 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.463873 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.464004 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] bindir = /usr/local/bin {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.464179 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.464319 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.464504 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.464633 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.464820 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.464905 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.465129 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.465224 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.465431 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.465522 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.465743 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.465825 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.466050 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.466133 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.466314 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.466401 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.466627 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.466716 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.466935 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.467028 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840377-1-iscsi {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.467236 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.467324 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.467536 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.467624 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.467840 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.467922 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.468133 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.468221 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.468450 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.468571 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.468738 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.468916 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.469060 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.469228 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.469370 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.469640 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.469735 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.469951 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.470055 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.470197 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.470282 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.470440 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.470593 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.470749 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.470925 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.471060 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.471237 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.471365 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.471545 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.471666 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.471862 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.471967 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.472167 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.472250 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.472512 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.472599 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.472825 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.472917 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.473144 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840377-1-iscsi {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.473272 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.473442 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.473536 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.473750 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.473842 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.474055 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.474146 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.474366 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.474502 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.474666 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.474758 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.474973 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.475065 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.475356 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.475444 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.475599 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.475684 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.475900 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.476063 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.476230 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.476321 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.476561 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.476658 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.476864 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.476948 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.477172 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.477255 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.477486 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.477592 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.477795 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.477898 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.478087 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.478172 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.478391 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.478485 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.478695 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.478784 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.478996 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.479079 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.479244 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.479327 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.479518 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.479601 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.479809 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.479891 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.480107 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.480195 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.480415 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.480576 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.480728 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.480812 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.480976 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.481073 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.481292 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.481374 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.481592 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.481673 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.481890 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.481984 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.482189 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.482272 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.482486 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.482575 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.482785 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.482875 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.483084 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.483172 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.483376 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.483457 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.483674 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.483770 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.484030 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.486924 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.486924 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.487129 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.487129 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.487498 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.487578 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.487874 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.487963 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.488087 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.488245 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.488350 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.488447 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.488447 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.488601 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.488680 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.488769 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.488852 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.488936 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.489020 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.489098 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.489183 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.489268 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.489345 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.489427 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.489558 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.489644 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.489720 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.489808 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.489892 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.489968 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.490049 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.490125 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.490214 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.490301 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.490384 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.490461 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.490536 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.490612 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.490695 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.490817 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.490908 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.491067 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.491192 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.491367 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.491493 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.491673 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.491790 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.491988 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.492071 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.492294 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.492391 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.492629 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.492721 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.492937 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.493020 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.493232 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.493321 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.493536 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.493617 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.493843 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.493926 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.494139 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.494221 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.494439 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.494522 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.494737 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.494820 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.495037 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.495120 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.495345 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.495437 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.495647 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.495770 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.495949 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.496040 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.496262 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.496345 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.496604 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.496701 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.496910 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.497001 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.497219 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.497346 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.497522 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.497614 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.497824 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.497905 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.498138 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.498219 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.498441 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.498552 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.498744 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.498835 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.499051 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.499140 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.499353 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.499442 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.499657 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.499741 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.500634 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.500758 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.500957 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.501112 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.501418 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.501502 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.501738 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.501821 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.502041 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.502144 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.502351 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.502446 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.502666 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.502757 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.502976 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.503069 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.503279 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.503367 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.503579 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.503660 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.503872 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.503957 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.504173 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.504263 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.504500 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.504603 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.504806 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.504897 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.505108 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.505190 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.505407 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.505496 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.505722 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.505806 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.506040 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.506121 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.506347 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.506435 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.506652 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.506733 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.506953 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.507042 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.507259 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.507353 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:18:57.507566 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.507651 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.507875 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.507957 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.508182 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.508271 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.508537 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.508623 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.508848 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.508931 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.509159 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.509256 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.509465 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.509602 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.509775 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.509859 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.510083 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.510175 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.510389 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.510473 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.510696 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.510786 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.510995 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.511091 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.511295 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.511378 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.511658 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.511771 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.511900 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.512040 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.512217 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.512745 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.512833 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.512911 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.513155 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.513255 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.513374 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.513516 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.513642 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.513766 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.513861 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.513941 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.514079 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.514519 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.514904 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.515043 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.515177 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.515248 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.515604 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.515739 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.516370 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.516492 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.516608 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.516689 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.516773 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.516858 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.516942 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.517020 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.517108 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.517192 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.517275 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.517358 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.517435 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.517523 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.517602 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.517678 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.517800 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.517886 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.518106 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.518199 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.518413 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.518498 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.518729 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.518813 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.519037 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.519130 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.519343 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.519428 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.519671 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.519763 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.519995 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.520088 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.520296 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.520379 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.520639 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.520726 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.520960 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.521052 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.521272 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.521364 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.521577 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.521660 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.521883 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.521968 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.522183 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.522266 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.522484 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.522566 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.522779 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.522862 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.523079 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.523162 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.523374 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.523456 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.523673 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.523785 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.523971 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.524059 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.524268 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.524359 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.524588 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.524687 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.524905 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.524997 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.525211 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.525350 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.525511 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.525597 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.525811 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.525900 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.526110 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.526247 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.526420 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.526504 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.526733 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.526817 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.527040 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.527136 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.527360 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.527444 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.527671 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.527779 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.527977 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.528073 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.528300 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.528383 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.528634 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.528727 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.528938 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.529030 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.529242 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.529331 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.529550 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.529634 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.529857 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.529945 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.530170 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.530251 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.530480 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.530569 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.530791 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.530881 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.531119 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.531210 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.531446 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.531600 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.531762 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.531905 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.532050 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.532172 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.532350 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.532527 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.532685 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.532850 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.532990 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.533158 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.533299 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.533472 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.533621 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.533780 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.533929 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.534087 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.534246 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.534393 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.534557 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.534706 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.534861 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.535011 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.535161 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.535316 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.535451 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.535622 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.535752 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.535925 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.536069 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.536227 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.536371 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.536574 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.536700 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.536884 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.537001 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.537194 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.537306 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.537501 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.537624 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.537807 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.537950 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.538151 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.538241 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.538458 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.538550 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.538799 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.538892 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.539139 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.539224 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.539443 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.539525 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.539749 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.539878 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.540054 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.540145 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.540352 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.540472 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.540711 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.540864 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.541141 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.541277 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.541366 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.541444 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.541574 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.541677 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.541877 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.541962 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.542242 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.542331 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.542484 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.542933 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.543118 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.543205 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.543290 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.543467 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.543601 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.543694 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.543781 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.543859 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.543935 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.544045 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.544663 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.544823 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.544976 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.545074 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.545151 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.545338 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.545582 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.545668 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.545753 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.545830 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.545907 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.545983 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.546068 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.546223 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.546360 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.546532 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.546617 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.547355 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.547528 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.547650 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.547965 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.548055 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.548347 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.548467 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.548616 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.548693 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.548929 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.549005 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.549235 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.549330 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.549547 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.549637 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.549860 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.549999 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.550167 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.550262 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.550474 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.550559 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.550789 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.550881 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.551097 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.551189 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.551400 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.551490 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.551707 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.551796 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.552013 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.552096 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.552320 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.552401 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.552647 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.552742 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.552954 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.553044 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.553261 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.553386 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.553564 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.553676 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.553873 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.554130 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.554216 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.554446 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.554529 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.554761 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.554859 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.555071 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.555154 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.555376 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.555641 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.555724 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.555974 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.556060 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.556291 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.556415 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.556629 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.556727 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.556947 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.557029 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.557266 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.557349 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.557571 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.557663 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.557876 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.557966 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.558198 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.558281 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.558498 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.558589 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.558803 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.558885 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.559102 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.559183 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.559407 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.559499 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.559722 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.559805 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.560023 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.560106 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.560323 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.560408 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.560647 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.560746 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.560953 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.561037 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.561253 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.561347 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.561557 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.561643 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.561857 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.561940 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.562156 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.562251 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.563061 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.563208 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.563379 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.563533 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.563722 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.563824 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.564039 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.564124 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.564353 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.564542 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.564694 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.564793 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.565006 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.565090 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.565312 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.565397 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.565617 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.565766 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.565929 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.566012 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.566240 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.566324 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.566548 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.566639 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.566860 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.566944 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.567180 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.567263 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.567490 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.567748 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.567832 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.568083 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.568166 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.568384 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.568506 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.568707 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.568839 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.569012 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.569104 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.569318 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.569426 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.569617 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.569920 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.570088 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.570268 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.570353 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.570441 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.570520 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.570603 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.570938 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.571228 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.571372 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.571639 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.571851 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.571997 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.572120 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.572200 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.572287 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.572374 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.572515 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.572598 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.572674 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.572917 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.573445 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.573615 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.573695 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.573772 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.574142 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.574320 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.574409 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.574495 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.574574 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.574651 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.574727 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.574803 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.574878 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.574962 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.575040 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.575117 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.575194 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.575319 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.575441 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.575643 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.575759 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.575955 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.576073 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.576260 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.576373 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.576590 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.576719 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.576900 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.577020 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.577333 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.577442 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.577554 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.577648 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.577889 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.577993 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.578248 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.578418 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.578566 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.578725 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.578876 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.578962 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.579183 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.579340 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.579483 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.579573 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.579802 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.579886 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.580103 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.580193 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.580402 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.580524 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.580727 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.580824 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.581028 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.581118 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.581390 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.581503 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.581654 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.581751 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.581962 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.582048 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.582267 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.582350 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.582574 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.582658 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.582878 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.582971 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.583185 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.583267 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.583487 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.583584 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.583788 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.583875 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.584090 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.584173 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.584395 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.584507 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.584720 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.584806 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.585020 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.585103 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.585331 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.585430 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.585638 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.585722 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.585939 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.586021 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.586247 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.586408 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.586549 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.586635 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.586853 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.586936 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.587148 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.587239 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.587452 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.587536 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.587756 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.587846 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.588059 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.588150 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.588359 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.588478 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.588686 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.588782 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.588989 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.589085 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.589293 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.589375 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.589599 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.589684 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.589901 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.589990 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.590203 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.590286 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.590504 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.590586 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.590805 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.590900 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.591106 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.591188 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.591400 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.591481 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.591719 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.591804 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.592022 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.592113 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.592314 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.592396 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.592641 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.592728 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.592940 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.593024 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.593247 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.593338 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.593543 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.593682 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.593990 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.594150 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.594349 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.594446 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.594670 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.594764 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.594969 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.595053 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.595274 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.595366 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.595581 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.595674 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.595892 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.595978 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.596199 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.596297 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.596527 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.596615 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.596836 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.596921 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.597159 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.597256 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.597473 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.597557 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.597785 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.597870 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.598100 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.598282 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.598424 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.598581 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.598697 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.598781 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.599013 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.599150 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.599311 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.599405 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.599630 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.599742 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.599932 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.600079 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.600329 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.600560 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.600560 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.600766 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.600853 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.600931 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.601131 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.601374 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.601465 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.601882 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.602006 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.602368 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.602508 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.602591 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.602681 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.602769 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.602854 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.602932 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.603008 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.603198 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.603795 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.603902 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.604027 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.604110 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.604525 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.604615 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.604693 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.604789 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.604882 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.604961 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.605045 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.605122 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.605198 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.605287 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.605366 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.605490 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.605700 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.605795 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.606016 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.606145 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.606327 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.606425 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.606634 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.606718 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.606944 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.607030 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.607255 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.607339 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.607573 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.607664 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.607889 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.607984 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.608195 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.608278 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.608603 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.608691 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.608922 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.609009 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.609825 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.609959 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.610087 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.610248 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.610402 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.610515 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.610664 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.610758 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.611228 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.611328 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.611554 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.611638 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.611861 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.611944 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.612167 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.612259 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.612490 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.612575 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.612801 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.612885 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.613105 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.613205 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.613406 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.613489 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.613704 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.613828 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.614001 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.614141 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.614316 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.614448 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.614612 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.614861 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.614953 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.615174 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.615259 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.615484 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.615569 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.615806 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.615967 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.616108 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.616190 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.616461 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.616556 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.616748 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.616845 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.617049 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.617133 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.617347 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.617444 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.617647 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.617739 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.617969 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.618051 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.618267 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.618359 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.618581 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.618673 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.618896 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.618986 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.619204 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.619339 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.619506 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.619590 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.619835 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.619921 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.620150 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.620233 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.620480 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.620578 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.620796 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.620885 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.621111 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.621195 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.621409 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.621493 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.621706 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.621818 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.622013 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.622141 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.622311 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.622465 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.622608 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.622773 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.622906 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.623079 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.623207 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.623392 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.623484 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.623701 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.623857 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.624011 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.624096 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.624334 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.624420 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.624666 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.624753 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.625528 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.625691 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.625852 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.626001 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.626115 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.626201 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.626413 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.626498 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.626709 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.626797 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.627044 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.627178 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.627340 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.627433 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.627659 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.627744 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.627968 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.628063 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.628304 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.628506 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.628625 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.628757 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.628928 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.629201 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.629390 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.629492 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.629574 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.629652 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.629837 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.629922 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.630140 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.630624 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.630624 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.631167 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.631296 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.631494 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.631618 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.631716 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.631797 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.631881 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.631959 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.632227 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.632318 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.632718 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.632807 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.632911 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.633031 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.633117 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.633117 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.633381 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.633460 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.633545 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.633623 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.633699 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.633868 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.634014 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.634154 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.634322 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.634461 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.634628 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.634772 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.634946 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.635078 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.635256 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.635382 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.635565 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.635687 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.635873 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.635996 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.636177 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.636299 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.636503 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.636627 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.636824 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.636932 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.637145 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.637288 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.637472 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.637559 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.637804 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.637888 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.638113 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.638197 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.638421 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.638512 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.638721 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.638804 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.639024 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.639126 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.639364 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.639456 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.639672 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.639757 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.639971 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.640068 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.640284 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.640370 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.640645 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.640771 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.640943 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.641252 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.641403 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.641561 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.641705 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.641930 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.642036 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.642249 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.642336 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.642568 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.642653 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.642888 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.642981 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.643205 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.643290 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.643511 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.643594 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.643830 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.643921 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.644148 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.644234 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.644482 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.644571 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.644817 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.644919 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.645085 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.645171 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.645395 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.645481 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.645908 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.646001 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.646222 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.646315 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.646552 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.646635 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.646874 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.646960 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.647187 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.647271 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.647497 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.647579 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.647809 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.647895 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.648116 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.648199 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.648416 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.648520 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.648736 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.648822 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.649038 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.649122 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.649339 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.649432 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.649636 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.649727 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.649938 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.650028 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.650243 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.650334 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.650542 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.650633 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.650855 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.650938 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.651158 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.651252 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.651530 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.651681 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.651850 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.652024 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.652208 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.652335 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.652557 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.652680 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.652869 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.652999 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.653191 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.653310 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.653515 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.653599 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.653837 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.653920 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.654156 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.654241 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.654476 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.654621 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.654784 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.654876 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.655090 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.655175 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.655388 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.655471 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.655687 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.655843 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.655991 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.656152 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.656384 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.656514 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.656728 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.657113 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.657251 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.657379 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.657508 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.657757 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.657914 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.658056 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.658139 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.658240 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.658327 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.658541 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.658958 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.659306 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.659581 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.659822 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.659955 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.660127 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.660127 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.660315 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.660539 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.660627 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.660821 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.660936 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.661040 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.661111 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.661182 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.661592 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.661685 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.661878 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.661974 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.662054 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.662131 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.662208 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.662286 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.662447 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.662561 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.662643 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.662722 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.662799 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.662902 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.663020 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.663201 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.663328 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.663499 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.663646 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.663812 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.663958 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.664117 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.664452 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.664539 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.664763 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.664847 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.665071 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.665158 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.665411 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.665495 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.665723 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.665818 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.666074 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.666249 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.666384 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.666578 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.666707 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.666894 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.667014 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.667228 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.667312 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.667562 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.667645 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.667881 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.667969 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.668181 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.668264 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.668515 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.668602 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.668827 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.668912 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.669131 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.669215 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.669435 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.669519 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.669739 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.669884 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.670042 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.670126 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.670340 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.670432 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.670644 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.670728 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.670947 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.671037 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.671248 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.671338 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.671548 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.672196 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.672370 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.672550 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.672715 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.672895 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.673047 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.673167 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.673363 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.673501 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.673677 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.673771 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.673988 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.674072 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.674299 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.674390 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.674606 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.674692 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.674909 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.674992 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.675211 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.675295 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.675512 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.675597 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.675821 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.675912 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.676142 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.676228 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.676460 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.676548 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.676768 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.676850 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.677084 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.677368 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.677463 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.677680 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.677765 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.677995 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.678079 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.678306 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.678397 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.678611 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.678693 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.678937 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.679023 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.679268 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.679483 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.679574 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.679821 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.679945 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.680149 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.680242 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.680503 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.680588 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.680804 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.680900 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.681111 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.681204 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.681441 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.681536 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.681744 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.681827 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.682060 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.682144 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.682368 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.682451 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.682677 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.682771 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.682982 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.683075 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.683289 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.683372 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.683599 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.683682 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.683907 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.683990 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.684214 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.684297 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.684547 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.684634 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.684862 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.684948 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.685166 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.685248 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.685476 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.685636 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.685781 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.685865 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.686087 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.686179 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.686393 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.686496 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.686722 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.687019 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.687019 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.687274 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.688677 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.688789 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.688789 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.688977 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.689056 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.689056 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.689204 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.689291 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.689453 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.689629 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.690149 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.690411 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.690578 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.690673 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.690754 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.690754 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.690895 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.691090 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.691186 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.691466 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.691642 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.691734 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.691869 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.691966 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.692078 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.692228 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.692410 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.692585 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.692773 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.692913 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.693102 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.693237 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.693430 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.693562 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.693738 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.693901 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.694044 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.694214 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.694350 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.694556 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.694665 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.694880 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.695003 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.695119 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 03 21:18:57.695321 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.695647 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.696169 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.696791 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.697349 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.697919 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.698487 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.699045 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.699595 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.700189 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.700835 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.701341 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.701900 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.702452 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.703046 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.703619 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.704192 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.704804 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.705320 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.705842 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.706371 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.706712 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.707038 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.707361 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.707698 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.708018 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.708342 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.708685 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.709006 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.709328 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.709650 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.709986 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.710316 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.710644 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.710971 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.711322 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.711640 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.711989 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.712317 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:18:57.712593 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 03 21:18:57.731836 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG oslo_db.sqlalchemy.engines [None req-d42e0e6b-83a2-4800-aa46-27e1251b79c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} May 03 21:18:57.749609 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG oslo_db.sqlalchemy.engines [None req-8d686247-6ce2-484b-a72d-60a83e7f577a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83313) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} May 03 21:18:57.977688 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.context [None req-d42e0e6b-83a2-4800-aa46-27e1251b79c1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3(cell1) {{(pid=83314) load_cells /opt/stack/nova/nova/context.py:465}} May 03 21:18:57.981862 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG oslo_concurrency.lockutils [None req-d42e0e6b-83a2-4800-aa46-27e1251b79c1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:18:57.983518 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG oslo_concurrency.lockutils [None req-d42e0e6b-83a2-4800-aa46-27e1251b79c1 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=83314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:18:57.984975 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG oslo_concurrency.lockutils [None req-d42e0e6b-83a2-4800-aa46-27e1251b79c1 None None] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:18:57.987348 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG oslo_concurrency.lockutils [None req-d42e0e6b-83a2-4800-aa46-27e1251b79c1 None None] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=83314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:18:57.994741 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.context [None req-8d686247-6ce2-484b-a72d-60a83e7f577a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3(cell1) {{(pid=83313) load_cells /opt/stack/nova/nova/context.py:465}} May 03 21:18:57.999073 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG oslo_concurrency.lockutils [None req-8d686247-6ce2-484b-a72d-60a83e7f577a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:18:58.001040 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG oslo_concurrency.lockutils [None req-8d686247-6ce2-484b-a72d-60a83e7f577a None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=83313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:18:58.001890 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG oslo_concurrency.lockutils [None req-8d686247-6ce2-484b-a72d-60a83e7f577a None None] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:18:58.003894 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG oslo_concurrency.lockutils [None req-8d686247-6ce2-484b-a72d-60a83e7f577a None None] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=83313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:18:58.013730 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG oslo_db.sqlalchemy.engines [None req-d42e0e6b-83a2-4800-aa46-27e1251b79c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} May 03 21:18:58.022172 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG oslo_db.sqlalchemy.engines [None req-d42e0e6b-83a2-4800-aa46-27e1251b79c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} May 03 21:18:58.035519 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG oslo_db.sqlalchemy.engines [None req-8d686247-6ce2-484b-a72d-60a83e7f577a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83313) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} May 03 21:18:58.036641 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG oslo_db.sqlalchemy.engines [None req-8d686247-6ce2-484b-a72d-60a83e7f577a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83313) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} May 03 21:18:58.051293 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG oslo_db.sqlalchemy.engines [None req-d42e0e6b-83a2-4800-aa46-27e1251b79c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} May 03 21:18:58.069243 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG oslo_db.sqlalchemy.engines [None req-8d686247-6ce2-484b-a72d-60a83e7f577a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83313) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} May 03 21:18:58.278580 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO keyring.backend [None req-d42e0e6b-83a2-4800-aa46-27e1251b79c1 None None] Loading KWallet May 03 21:18:58.288379 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO keyring.backend [None req-d42e0e6b-83a2-4800-aa46-27e1251b79c1 None None] Loading SecretService May 03 21:18:58.292244 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO keyring.backend [None req-d42e0e6b-83a2-4800-aa46-27e1251b79c1 None None] Loading Windows May 03 21:18:58.294086 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO keyring.backend [None req-d42e0e6b-83a2-4800-aa46-27e1251b79c1 None None] Loading chainer May 03 21:18:58.294860 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO keyring.backend [None req-d42e0e6b-83a2-4800-aa46-27e1251b79c1 None None] Loading macOS May 03 21:18:58.299546 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO keyring.backend [None req-8d686247-6ce2-484b-a72d-60a83e7f577a None None] Loading KWallet May 03 21:18:58.308418 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO keyring.backend [None req-8d686247-6ce2-484b-a72d-60a83e7f577a None None] Loading SecretService May 03 21:18:58.312330 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO keyring.backend [None req-8d686247-6ce2-484b-a72d-60a83e7f577a None None] Loading Windows May 03 21:18:58.314159 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO keyring.backend [None req-8d686247-6ce2-484b-a72d-60a83e7f577a None None] Loading chainer May 03 21:18:58.314948 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO keyring.backend [None req-8d686247-6ce2-484b-a72d-60a83e7f577a None None] Loading macOS May 03 21:18:58.641942 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: WARNING keystonemiddleware.auth_token [None req-d42e0e6b-83a2-4800-aa46-27e1251b79c1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 03 21:18:58.648354 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: WARNING keystonemiddleware.auth_token [None req-d42e0e6b-83a2-4800-aa46-27e1251b79c1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 03 21:18:58.659562 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: WARNING keystonemiddleware.auth_token [None req-8d686247-6ce2-484b-a72d-60a83e7f577a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 03 21:18:58.665971 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: WARNING keystonemiddleware.auth_token [None req-8d686247-6ce2-484b-a72d-60a83e7f577a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 03 21:18:58.862705 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: WARNING keystonemiddleware.auth_token [None req-d42e0e6b-83a2-4800-aa46-27e1251b79c1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 03 21:18:58.868192 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: WARNING keystonemiddleware.auth_token [None req-d42e0e6b-83a2-4800-aa46-27e1251b79c1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 03 21:18:58.873450 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558929fa89c0 pid: 83314 (default app) May 03 21:18:58.875571 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-d42e0e6b-83a2-4800-aa46-27e1251b79c1 None None] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:18:58.876691 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.requestlog [None req-d42e0e6b-83a2-4800-aa46-27e1251b79c1 None None] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001691 May 03 21:18:58.877110 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: [pid: 83314|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 788 bytes} [Tue May 3 21:18:58 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:18:58.883913 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: WARNING keystonemiddleware.auth_token [None req-8d686247-6ce2-484b-a72d-60a83e7f577a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 03 21:18:58.889085 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: WARNING keystonemiddleware.auth_token [None req-8d686247-6ce2-484b-a72d-60a83e7f577a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 03 21:18:58.894838 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558929fa89c0 pid: 83313 (default app) May 03 21:20:20.180718 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-3c7e12af-cc5d-47fa-8e14-99070070cc8d admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:20:20.203718 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.requestlog [None req-3c7e12af-cc5d-47fa-8e14-99070070cc8d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 15 microversion: 2.1 time: 0.464749 May 03 21:20:20.204287 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: [pid: 83314|app: 0|req: 2/2] 10.222.0.48 () {58 vars in 1159 bytes} [Tue May 3 21:20:19 2022] GET /compute/v2.1/flavors/detail => generated 15 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 03 21:20:22.602054 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-19433aa8-04dc-44c2-9658-7b3a4fcc8ef3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "vcpus": 1, "disk": 1, "id": "c1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:20:22.626292 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:20:22.626292 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: warnings.warn(msg) May 03 21:20:22.708200 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-19433aa8-04dc-44c2-9658-7b3a4fcc8ef3 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 367 microversion: 2.1 time: 0.425565 May 03 21:20:22.708831 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: [pid: 83313|app: 0|req: 1/3] 10.222.0.48 () {62 vars in 1192 bytes} [Tue May 3 21:20:22 2022] POST /compute/v2.1/flavors => generated 367 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:20:22.724186 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-1731242d-8c2e-4dc7-8d1d-97d2c59f5f60 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:20:22.731098 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:20:22.731098 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: warnings.warn(msg) May 03 21:20:22.836775 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.requestlog [None req-1731242d-8c2e-4dc7-8d1d-97d2c59f5f60 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.121377 May 03 21:20:22.837343 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: [pid: 83314|app: 0|req: 3/4] 10.222.0.48 () {62 vars in 1245 bytes} [Tue May 3 21:20:22 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 03 21:20:22.852889 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-a8d56923-f7c1-4dea-8598-4b2da490b7fe admin admin] Calling method '>' {{(pid=83313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:20:22.877431 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-a8d56923-f7c1-4dea-8598-4b2da490b7fe admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.034154 May 03 21:20:22.877879 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: [pid: 83313|app: 0|req: 2/5] 10.222.0.48 () {58 vars in 1192 bytes} [Tue May 3 21:20:22 2022] GET /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 03 21:20:25.045619 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-e8ab5dda-2dbc-4288-8c99-811a9bc37772 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "ram": 512, "vcpus": 1, "disk": 5, "id": "d1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:20:25.067938 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:20:25.067938 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: warnings.warn(msg) May 03 21:20:25.245725 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.requestlog [None req-e8ab5dda-2dbc-4288-8c99-811a9bc37772 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.281251 May 03 21:20:25.246370 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: [pid: 83314|app: 0|req: 4/6] 10.222.0.48 () {62 vars in 1192 bytes} [Tue May 3 21:20:24 2022] POST /compute/v2.1/flavors => generated 364 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:20:25.261452 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-a88d37b3-d668-4739-8b7f-98a18735eb01 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:20:25.269123 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:20:25.269123 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: warnings.warn(msg) May 03 21:20:25.390805 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-a88d37b3-d668-4739-8b7f-98a18735eb01 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.137538 May 03 21:20:25.391313 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: [pid: 83313|app: 0|req: 3/7] 10.222.0.48 () {62 vars in 1245 bytes} [Tue May 3 21:20:25 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 03 21:20:25.406036 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-b86e9700-27b4-4e53-ad18-a2ce100593ae admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:20:25.537886 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.requestlog [None req-b86e9700-27b4-4e53-ad18-a2ce100593ae admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.140823 May 03 21:20:25.538459 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: [pid: 83314|app: 0|req: 5/8] 10.222.0.48 () {58 vars in 1192 bytes} [Tue May 3 21:20:25 2022] GET /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 03 21:20:27.724055 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-630f6e87-dc2c-414d-a704-5e8e7c0b6a47 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "vcpus": 1, "disk": 10, "id": "d2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:20:27.903419 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-630f6e87-dc2c-414d-a704-5e8e7c0b6a47 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.257498 May 03 21:20:27.904002 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: [pid: 83313|app: 0|req: 4/9] 10.222.0.48 () {62 vars in 1192 bytes} [Tue May 3 21:20:27 2022] POST /compute/v2.1/flavors => generated 364 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:20:27.919250 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-a08252d1-3e46-4c7f-bbf4-d96315590d6c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:20:28.023253 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.requestlog [None req-a08252d1-3e46-4c7f-bbf4-d96315590d6c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.112354 May 03 21:20:28.023847 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: [pid: 83314|app: 0|req: 6/10] 10.222.0.48 () {62 vars in 1245 bytes} [Tue May 3 21:20:27 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 03 21:20:28.038537 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-ebd99940-c060-44fd-b082-5562b4489e11 admin admin] Calling method '>' {{(pid=83313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:20:28.072298 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-ebd99940-c060-44fd-b082-5562b4489e11 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.042548 May 03 21:20:28.072886 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: [pid: 83313|app: 0|req: 5/11] 10.222.0.48 () {58 vars in 1192 bytes} [Tue May 3 21:20:28 2022] GET /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 03 21:20:30.282746 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-b162b87a-b456-4b6e-98ec-54907683b42f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "vcpus": 2, "disk": 10, "id": "d3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:20:30.379282 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.requestlog [None req-b162b87a-b456-4b6e-98ec-54907683b42f admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.174406 May 03 21:20:30.379792 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: [pid: 83314|app: 0|req: 7/12] 10.222.0.48 () {62 vars in 1192 bytes} [Tue May 3 21:20:30 2022] POST /compute/v2.1/flavors => generated 364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:20:30.394803 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-7c4c389c-72cb-472e-83f3-5df36d7e39db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:20:30.509327 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-7c4c389c-72cb-472e-83f3-5df36d7e39db admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.123070 May 03 21:20:30.509920 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: [pid: 83313|app: 0|req: 6/13] 10.222.0.48 () {62 vars in 1245 bytes} [Tue May 3 21:20:30 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 03 21:20:30.524094 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-61094fa9-7125-4e64-b57f-279323699fb7 admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:20:30.543543 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.requestlog [None req-61094fa9-7125-4e64-b57f-279323699fb7 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.027812 May 03 21:20:30.544071 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: [pid: 83314|app: 0|req: 8/14] 10.222.0.48 () {58 vars in 1192 bytes} [Tue May 3 21:20:30 2022] GET /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 03 21:20:32.740470 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-f4c161e0-ef55-4273-b701-289864e313e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "ram": 4096, "vcpus": 4, "disk": 20, "id": "d4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:20:32.858874 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-f4c161e0-ef55-4273-b701-289864e313e1 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.205365 May 03 21:20:32.859561 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: [pid: 83313|app: 0|req: 7/15] 10.222.0.48 () {62 vars in 1192 bytes} [Tue May 3 21:20:32 2022] POST /compute/v2.1/flavors => generated 364 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:20:32.875701 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-5975ecd4-6bfc-471b-8e48-0bf2101a07f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:20:32.984389 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.requestlog [None req-5975ecd4-6bfc-471b-8e48-0bf2101a07f3 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.116828 May 03 21:20:32.985023 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: [pid: 83314|app: 0|req: 9/16] 10.222.0.48 () {62 vars in 1245 bytes} [Tue May 3 21:20:32 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 03 21:20:33.001449 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-9b4a0d92-b46b-4a1a-af06-49cb01230e1f admin admin] Calling method '>' {{(pid=83313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:20:33.022183 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-9b4a0d92-b46b-4a1a-af06-49cb01230e1f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.030660 May 03 21:20:33.022737 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: [pid: 83313|app: 0|req: 8/17] 10.222.0.48 () {58 vars in 1192 bytes} [Tue May 3 21:20:32 2022] GET /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 03 21:20:35.169279 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-5a99c4c9-e29a-494f-90f7-aa39a65532bf admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:20:35.188010 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.requestlog [None req-5a99c4c9-e29a-494f-90f7-aa39a65532bf admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 1786 microversion: 2.1 time: 0.096665 May 03 21:20:35.188578 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: [pid: 83314|app: 0|req: 10/18] 10.222.0.48 () {58 vars in 1159 bytes} [Tue May 3 21:20:35 2022] GET /compute/v2.1/flavors/detail => generated 1786 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:20:37.341388 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-d91c3dc2-6696-4c37-8691-0613882df1e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "vcpus": 1, "disk": 1, "id": "1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:20:37.435105 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-d91c3dc2-6696-4c37-8691-0613882df1e6 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 362 microversion: 2.1 time: 0.171106 May 03 21:20:37.435610 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: [pid: 83313|app: 0|req: 9/19] 10.222.0.48 () {62 vars in 1192 bytes} [Tue May 3 21:20:37 2022] POST /compute/v2.1/flavors => generated 362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:20:37.451165 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-2285a284-430e-417a-920f-50544465ade1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:20:37.531908 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.requestlog [None req-2285a284-430e-417a-920f-50544465ade1 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.089103 May 03 21:20:37.532523 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: [pid: 83314|app: 0|req: 11/20] 10.222.0.48 () {62 vars in 1242 bytes} [Tue May 3 21:20:37 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 03 21:20:37.546683 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-7570478e-0ff9-4fb4-93f6-881fd3b731c7 admin admin] Calling method '>' {{(pid=83313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:20:37.566203 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-7570478e-0ff9-4fb4-93f6-881fd3b731c7 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.027961 May 03 21:20:37.566726 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: [pid: 83313|app: 0|req: 10/21] 10.222.0.48 () {58 vars in 1189 bytes} [Tue May 3 21:20:37 2022] GET /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 03 21:20:39.731164 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-03ea4f6d-6034-42c4-8827-9740b79af817 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "ram": 2048, "vcpus": 1, "disk": 20, "id": "2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:20:39.818149 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.requestlog [None req-03ea4f6d-6034-42c4-8827-9740b79af817 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 365 microversion: 2.1 time: 0.165065 May 03 21:20:39.818643 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: [pid: 83314|app: 0|req: 12/22] 10.222.0.48 () {62 vars in 1192 bytes} [Tue May 3 21:20:39 2022] POST /compute/v2.1/flavors => generated 365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:20:39.833655 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-7dfa4da2-d824-4d30-b057-cd9fe9c23e10 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:20:39.937088 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-7dfa4da2-d824-4d30-b057-cd9fe9c23e10 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.112024 May 03 21:20:39.937683 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: [pid: 83313|app: 0|req: 11/23] 10.222.0.48 () {62 vars in 1242 bytes} [Tue May 3 21:20:39 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 03 21:20:39.951764 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-75aa6e11-b304-4973-88af-85d39e515e52 admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:20:39.972196 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.requestlog [None req-75aa6e11-b304-4973-88af-85d39e515e52 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.028848 May 03 21:20:39.972758 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: [pid: 83314|app: 0|req: 13/24] 10.222.0.48 () {58 vars in 1189 bytes} [Tue May 3 21:20:39 2022] GET /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 03 21:20:42.163612 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-bebbed5d-be45-446e-80d4-82a0be82b7a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "vcpus": 2, "disk": 40, "id": "3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:20:42.247345 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-bebbed5d-be45-446e-80d4-82a0be82b7a1 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 366 microversion: 2.1 time: 0.162036 May 03 21:20:42.247908 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: [pid: 83313|app: 0|req: 12/25] 10.222.0.48 () {62 vars in 1192 bytes} [Tue May 3 21:20:42 2022] POST /compute/v2.1/flavors => generated 366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:20:42.263817 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-be23678f-2c76-4fee-adef-facec1a514c4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:20:42.354111 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.requestlog [None req-be23678f-2c76-4fee-adef-facec1a514c4 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.099062 May 03 21:20:42.354759 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: [pid: 83314|app: 0|req: 14/26] 10.222.0.48 () {62 vars in 1242 bytes} [Tue May 3 21:20:42 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 03 21:20:42.370114 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-728804bb-2c29-487a-a426-676a0d32dec1 admin admin] Calling method '>' {{(pid=83313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:20:42.389692 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-728804bb-2c29-487a-a426-676a0d32dec1 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.028639 May 03 21:20:42.390218 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: [pid: 83313|app: 0|req: 13/27] 10.222.0.48 () {58 vars in 1189 bytes} [Tue May 3 21:20:42 2022] GET /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 03 21:20:44.548843 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-af0f60d2-826c-4c64-82ec-6f71933ba98c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "vcpus": 4, "disk": 80, "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:20:44.653007 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.requestlog [None req-af0f60d2-826c-4c64-82ec-6f71933ba98c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 365 microversion: 2.1 time: 0.183692 May 03 21:20:44.653500 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: [pid: 83314|app: 0|req: 15/28] 10.222.0.48 () {62 vars in 1192 bytes} [Tue May 3 21:20:44 2022] POST /compute/v2.1/flavors => generated 365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:20:44.668970 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-fd28f40b-f2bb-44cd-ad95-d1a179010db7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:20:44.772605 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-fd28f40b-f2bb-44cd-ad95-d1a179010db7 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.112217 May 03 21:20:44.773190 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: [pid: 83313|app: 0|req: 14/29] 10.222.0.48 () {62 vars in 1242 bytes} [Tue May 3 21:20:44 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 03 21:20:44.788207 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-b4b476a2-fe3b-4d02-83bf-92a69a94da85 admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:20:44.807090 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.requestlog [None req-b4b476a2-fe3b-4d02-83bf-92a69a94da85 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.028078 May 03 21:20:44.807613 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: [pid: 83314|app: 0|req: 16/30] 10.222.0.48 () {58 vars in 1189 bytes} [Tue May 3 21:20:44 2022] GET /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 03 21:20:47.025754 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-495f0367-7d45-4487-b2ed-8b572d3e2492 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "vcpus": 8, "disk": 160, "id": "5", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:20:47.094014 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-495f0367-7d45-4487-b2ed-8b572d3e2492 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 368 microversion: 2.1 time: 0.147141 May 03 21:20:47.094518 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: [pid: 83313|app: 0|req: 15/31] 10.222.0.48 () {62 vars in 1192 bytes} [Tue May 3 21:20:46 2022] POST /compute/v2.1/flavors => generated 368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:20:47.109268 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-dbf2b0d4-a986-4827-9a0f-d2e06522928f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:20:47.200408 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.requestlog [None req-dbf2b0d4-a986-4827-9a0f-d2e06522928f admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.099684 May 03 21:20:47.201000 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: [pid: 83314|app: 0|req: 17/32] 10.222.0.48 () {62 vars in 1242 bytes} [Tue May 3 21:20:47 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 03 21:20:47.215717 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-6008e566-5824-4d4d-a3c5-343925ec835f admin admin] Calling method '>' {{(pid=83313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:20:47.237232 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-6008e566-5824-4d4d-a3c5-343925ec835f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.029968 May 03 21:20:47.237775 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: [pid: 83313|app: 0|req: 16/33] 10.222.0.48 () {58 vars in 1189 bytes} [Tue May 3 21:20:47 2022] GET /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 03 21:21:56.863953 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-696b9117-acf2-4127-9142-aa58093eb04b admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:21:56.885739 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.requestlog [None req-696b9117-acf2-4127-9142-aa58093eb04b admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 3562 microversion: 2.1 time: 0.101467 May 03 21:21:56.886284 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: [pid: 83314|app: 0|req: 18/34] 10.222.0.48 () {58 vars in 1159 bytes} [Tue May 3 21:21:56 2022] GET /compute/v2.1/flavors/detail => generated 3562 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:21:58.299034 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-6008e566-5824-4d4d-a3c5-343925ec835f admin admin] Calling method '>' {{(pid=83313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:21:58.300038 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-6008e566-5824-4d4d-a3c5-343925ec835f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 May 03 21:21:58.300521 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: [pid: 83313|app: 0|req: 17/35] 10.222.0.48 () {56 vars in 1074 bytes} [Tue May 3 21:21:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:21:58.515460 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-11e9b73e-10f1-4e38-8ca2-f746539fc501 admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:21:58.528413 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.wsgi [None req-11e9b73e-10f1-4e38-8ca2-f746539fc501 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 03 21:21:58.529008 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-11e9b73e-10f1-4e38-8ca2-f746539fc501 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=83314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:21:58.529802 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.requestlog [None req-11e9b73e-10f1-4e38-8ca2-f746539fc501 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.87 time: 0.094491 May 03 21:21:58.530340 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: [pid: 83314|app: 0|req: 19/36] 10.222.0.48 () {60 vars in 1190 bytes} [Tue May 3 21:21:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 03 21:21:58.545024 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-3790044f-a731-432a-92d5-4a44d877d9e5 admin admin] Calling method '>' {{(pid=83313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:21:58.564803 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-3790044f-a731-432a-92d5-4a44d877d9e5 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.027951 May 03 21:21:58.565324 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: [pid: 83313|app: 0|req: 18/37] 10.222.0.48 () {60 vars in 1210 bytes} [Tue May 3 21:21:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 21:21:58.580106 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-10bff703-27b9-49cd-83a8-409fbb392084 admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:21:58.601399 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.requestlog [None req-10bff703-27b9-49cd-83a8-409fbb392084 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.030377 May 03 21:21:58.601925 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: [pid: 83314|app: 0|req: 20/38] 10.222.0.48 () {60 vars in 1210 bytes} [Tue May 3 21:21:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:21:58.616097 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-9cb0f5bb-e733-4f1c-980e-e0711c66a0ea admin admin] Calling method '>' {{(pid=83313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:21:58.628023 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.wsgi [None req-9cb0f5bb-e733-4f1c-980e-e0711c66a0ea admin admin] HTTP exception thrown: Flavor 42 could not be found. May 03 21:21:58.628646 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-9cb0f5bb-e733-4f1c-980e-e0711c66a0ea admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=83313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:21:58.629429 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-9cb0f5bb-e733-4f1c-980e-e0711c66a0ea admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.87 time: 0.021860 May 03 21:21:58.629929 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: [pid: 83313|app: 0|req: 19/39] 10.222.0.48 () {60 vars in 1190 bytes} [Tue May 3 21:21:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 03 21:21:59.990508 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-10bff703-27b9-49cd-83a8-409fbb392084 admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:21:59.991506 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.requestlog [None req-10bff703-27b9-49cd-83a8-409fbb392084 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001670 May 03 21:21:59.991900 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: [pid: 83314|app: 0|req: 21/40] 10.222.0.48 () {56 vars in 1074 bytes} [Tue May 3 21:21:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:22:00.203332 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-550e09e5-d9f5-4781-af10-c8d010a863dd admin admin] Calling method '>' {{(pid=83313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:22:00.215669 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.wsgi [None req-550e09e5-d9f5-4781-af10-c8d010a863dd admin admin] HTTP exception thrown: Flavor 84 could not be found. May 03 21:22:00.216235 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-550e09e5-d9f5-4781-af10-c8d010a863dd admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=83313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:22:00.217058 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-550e09e5-d9f5-4781-af10-c8d010a863dd admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.87 time: 0.091304 May 03 21:22:00.217575 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: [pid: 83313|app: 0|req: 20/41] 10.222.0.48 () {60 vars in 1190 bytes} [Tue May 3 21:22:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 03 21:22:00.232100 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-1db9e5a1-eb70-4d40-a034-750b7552adef admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:22:00.252689 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.requestlog [None req-1db9e5a1-eb70-4d40-a034-750b7552adef admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.028698 May 03 21:22:00.253229 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: [pid: 83314|app: 0|req: 22/42] 10.222.0.48 () {60 vars in 1210 bytes} [Tue May 3 21:22:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:22:00.267807 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-97ac35b5-c22b-4a64-84ae-a665f769bbe6 admin admin] Calling method '>' {{(pid=83313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:22:00.287333 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-97ac35b5-c22b-4a64-84ae-a665f769bbe6 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.028294 May 03 21:22:00.287867 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: [pid: 83313|app: 0|req: 21/43] 10.222.0.48 () {60 vars in 1210 bytes} [Tue May 3 21:22:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:22:00.301616 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-163d7351-f305-4e83-9fe7-03b574185237 admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:22:00.313918 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.wsgi [None req-163d7351-f305-4e83-9fe7-03b574185237 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 03 21:22:00.314480 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-163d7351-f305-4e83-9fe7-03b574185237 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=83314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:22:00.315254 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.requestlog [None req-163d7351-f305-4e83-9fe7-03b574185237 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.87 time: 0.021908 May 03 21:22:00.315748 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: [pid: 83314|app: 0|req: 23/44] 10.222.0.48 () {60 vars in 1190 bytes} [Tue May 3 21:22:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 03 21:22:01.702589 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-97ac35b5-c22b-4a64-84ae-a665f769bbe6 admin admin] Calling method '>' {{(pid=83313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:22:01.704170 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-97ac35b5-c22b-4a64-84ae-a665f769bbe6 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 May 03 21:22:01.704611 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: [pid: 83313|app: 0|req: 22/45] 10.222.0.48 () {56 vars in 1074 bytes} [Tue May 3 21:22:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:22:01.918802 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-7c4a0aa8-1fcb-49e8-89b2-6854cb2f9ba7 admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:22:01.930729 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.wsgi [None req-7c4a0aa8-1fcb-49e8-89b2-6854cb2f9ba7 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 03 21:22:01.931295 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-7c4a0aa8-1fcb-49e8-89b2-6854cb2f9ba7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=83314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:22:01.932077 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.requestlog [None req-7c4a0aa8-1fcb-49e8-89b2-6854cb2f9ba7 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.87 time: 0.092510 May 03 21:22:01.932612 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: [pid: 83314|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1193 bytes} [Tue May 3 21:22:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 03 21:22:01.946989 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-d7a281c8-c97b-41da-9a13-0a9e1179023a admin admin] Calling method '>' {{(pid=83313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:22:01.967189 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-d7a281c8-c97b-41da-9a13-0a9e1179023a admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.028419 May 03 21:22:01.967725 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: [pid: 83313|app: 0|req: 23/47] 10.222.0.48 () {60 vars in 1210 bytes} [Tue May 3 21:22:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 21:22:01.982225 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-fc33ce63-301f-4d7a-a4d8-8fc9f215398a admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:22:02.002600 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.requestlog [None req-fc33ce63-301f-4d7a-a4d8-8fc9f215398a admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.028652 May 03 21:22:02.003145 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: [pid: 83314|app: 0|req: 25/48] 10.222.0.48 () {60 vars in 1210 bytes} [Tue May 3 21:22:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:22:02.018137 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-c3e2d29d-eecd-42f2-8e95-22fd99dd3094 admin admin] Calling method '>' {{(pid=83313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:22:02.030153 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.wsgi [None req-c3e2d29d-eecd-42f2-8e95-22fd99dd3094 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 03 21:22:02.030770 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-c3e2d29d-eecd-42f2-8e95-22fd99dd3094 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=83313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:22:02.031571 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-c3e2d29d-eecd-42f2-8e95-22fd99dd3094 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.87 time: 0.022460 May 03 21:22:02.032154 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: [pid: 83313|app: 0|req: 24/49] 10.222.0.48 () {60 vars in 1193 bytes} [Tue May 3 21:22:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 03 21:22:03.419246 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-fc33ce63-301f-4d7a-a4d8-8fc9f215398a admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:22:03.420253 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.requestlog [None req-fc33ce63-301f-4d7a-a4d8-8fc9f215398a admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 May 03 21:22:03.420755 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: [pid: 83314|app: 0|req: 26/50] 10.222.0.48 () {56 vars in 1074 bytes} [Tue May 3 21:22:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:22:03.636675 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-83b1aaaa-a973-40a7-a108-b05858bbb230 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:22:03.739106 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-83b1aaaa-a973-40a7-a108-b05858bbb230 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.87 time: 0.181378 May 03 21:22:03.739646 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: [pid: 83313|app: 0|req: 25/51] 10.222.0.48 () {64 vars in 1235 bytes} [Tue May 3 21:22:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 21:22:05.138244 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-fc33ce63-301f-4d7a-a4d8-8fc9f215398a admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:22:05.139283 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.requestlog [None req-fc33ce63-301f-4d7a-a4d8-8fc9f215398a admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 May 03 21:22:05.139685 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: [pid: 83314|app: 0|req: 27/52] 10.222.0.48 () {56 vars in 1074 bytes} [Tue May 3 21:22:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:22:05.350883 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-f8584b06-d32b-4249-9703-dc3f6cded170 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:22:05.431674 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-f8584b06-d32b-4249-9703-dc3f6cded170 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.87 time: 0.157823 May 03 21:22:05.432515 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: [pid: 83313|app: 0|req: 26/53] 10.222.0.48 () {64 vars in 1235 bytes} [Tue May 3 21:22:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 21:22:06.832640 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-fc33ce63-301f-4d7a-a4d8-8fc9f215398a admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:22:06.833648 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.requestlog [None req-fc33ce63-301f-4d7a-a4d8-8fc9f215398a admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 May 03 21:22:06.834055 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: [pid: 83314|app: 0|req: 28/54] 10.222.0.48 () {56 vars in 1074 bytes} [Tue May 3 21:22:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:22:07.051385 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-6f23e3fa-4f08-483c-865c-ee03ac773ab6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:22:07.134382 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-6f23e3fa-4f08-483c-865c-ee03ac773ab6 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.87 time: 0.161156 May 03 21:22:07.134949 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: [pid: 83313|app: 0|req: 27/55] 10.222.0.48 () {64 vars in 1235 bytes} [Tue May 3 21:22:06 2022] POST /compute/v2.1/flavors => generated 407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 03 21:22:08.477712 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-fc33ce63-301f-4d7a-a4d8-8fc9f215398a admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:22:08.478703 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.requestlog [None req-fc33ce63-301f-4d7a-a4d8-8fc9f215398a admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 May 03 21:22:08.479100 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: [pid: 83314|app: 0|req: 29/56] 10.222.0.48 () {56 vars in 1074 bytes} [Tue May 3 21:22:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:22:08.694154 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-09292f71-2d83-46a3-a740-5b6deceeb62e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:22:08.857890 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-09292f71-2d83-46a3-a740-5b6deceeb62e admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.87 time: 0.243238 May 03 21:22:08.858442 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: [pid: 83313|app: 0|req: 28/57] 10.222.0.48 () {64 vars in 1235 bytes} [Tue May 3 21:22:08 2022] POST /compute/v2.1/flavors => generated 409 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 21:22:10.226732 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-fc33ce63-301f-4d7a-a4d8-8fc9f215398a admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:22:10.227749 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.requestlog [None req-fc33ce63-301f-4d7a-a4d8-8fc9f215398a admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 May 03 21:22:10.228154 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: [pid: 83314|app: 0|req: 30/58] 10.222.0.48 () {56 vars in 1074 bytes} [Tue May 3 21:22:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:22:10.442939 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-e30fdb05-c768-4841-b173-ac65b7973d4a admin admin] Calling method '>' {{(pid=83313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:22:10.473795 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-e30fdb05-c768-4841-b173-ac65b7973d4a admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.87 time: 0.109545 May 03 21:22:10.474349 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: [pid: 83313|app: 0|req: 29/59] 10.222.0.48 () {60 vars in 1202 bytes} [Tue May 3 21:22:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:22:48.834780 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-fc33ce63-301f-4d7a-a4d8-8fc9f215398a admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:22:48.835789 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.requestlog [None req-fc33ce63-301f-4d7a-a4d8-8fc9f215398a admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 May 03 21:22:48.836187 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: [pid: 83314|app: 0|req: 31/60] 10.222.0.48 () {56 vars in 1074 bytes} [Tue May 3 21:22:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:22:49.055085 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-e9c8653f-2f3d-4b7c-962f-5d74195fdeb6 admin admin] Calling method '>' {{(pid=83313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:22:49.086735 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-e9c8653f-2f3d-4b7c-962f-5d74195fdeb6 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.87 time: 0.112406 May 03 21:22:49.087289 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: [pid: 83313|app: 0|req: 30/61] 10.222.0.48 () {60 vars in 1202 bytes} [Tue May 3 21:22:48 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:24:28.937600 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-ffddac82-3289-4f9d-ba17-ff60253d9f99 tempest-verify_tempest_config-1727365729 tempest-verify_tempest_config-1727365729-project] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:24:28.944139 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.requestlog [None req-ffddac82-3289-4f9d-ba17-ff60253d9f99 tempest-verify_tempest_config-1727365729 tempest-verify_tempest_config-1727365729-project] 10.222.0.48 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.157522 May 03 21:24:28.944719 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: [pid: 83314|app: 0|req: 32/62] 10.222.0.48 () {58 vars in 1133 bytes} [Tue May 3 21:24:28 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 21:26:14.460086 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-e9c8653f-2f3d-4b7c-962f-5d74195fdeb6 admin admin] Calling method '>' {{(pid=83313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:26:14.461116 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-e9c8653f-2f3d-4b7c-962f-5d74195fdeb6 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 May 03 21:26:14.461648 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: [pid: 83313|app: 0|req: 31/63] 10.222.0.48 () {56 vars in 1074 bytes} [Tue May 3 21:26:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:26:14.743837 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-e2129bc2-4a25-4c94-8868-24890fe72c1e admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:26:14.749676 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:26:14.749676 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: warnings.warn(msg) May 03 21:26:14.751159 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG oslo_concurrency.lockutils [None req-e2129bc2-4a25-4c94-8868-24890fe72c1e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:26:14.751599 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG oslo_concurrency.lockutils [None req-e2129bc2-4a25-4c94-8868-24890fe72c1e admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=83314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:26:14.752379 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG oslo_concurrency.lockutils [None req-e2129bc2-4a25-4c94-8868-24890fe72c1e admin admin] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:26:14.752824 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG oslo_concurrency.lockutils [None req-e2129bc2-4a25-4c94-8868-24890fe72c1e admin admin] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=83314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:26:14.783480 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.requestlog [None req-e2129bc2-4a25-4c94-8868-24890fe72c1e admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.87 time: 0.186200 May 03 21:26:14.784039 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: [pid: 83314|app: 0|req: 33/64] 10.222.0.48 () {60 vars in 1193 bytes} [Tue May 3 21:26:14 2022] GET /compute/v2.1/os-services => generated 791 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 21:26:16.126486 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-e9c8653f-2f3d-4b7c-962f-5d74195fdeb6 admin admin] Calling method '>' {{(pid=83313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:26:16.127486 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-e9c8653f-2f3d-4b7c-962f-5d74195fdeb6 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 May 03 21:26:16.127871 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: [pid: 83313|app: 0|req: 32/65] 10.222.0.48 () {56 vars in 1074 bytes} [Tue May 3 21:26:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:26:16.341688 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-c3e0283d-0b7e-47ac-8a9b-b7935abcfe02 admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:26:16.347471 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:26:16.347471 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: warnings.warn(msg) May 03 21:26:16.349036 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG oslo_concurrency.lockutils [None req-c3e0283d-0b7e-47ac-8a9b-b7935abcfe02 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:26:16.349628 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG oslo_concurrency.lockutils [None req-c3e0283d-0b7e-47ac-8a9b-b7935abcfe02 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:26:16.350417 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG oslo_concurrency.lockutils [None req-c3e0283d-0b7e-47ac-8a9b-b7935abcfe02 admin admin] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:26:16.350847 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG oslo_concurrency.lockutils [None req-c3e0283d-0b7e-47ac-8a9b-b7935abcfe02 admin admin] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=83314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:26:16.374170 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.requestlog [None req-c3e0283d-0b7e-47ac-8a9b-b7935abcfe02 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.87 time: 0.111424 May 03 21:26:16.374709 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: [pid: 83314|app: 0|req: 34/66] 10.222.0.48 () {60 vars in 1193 bytes} [Tue May 3 21:26:16 2022] GET /compute/v2.1/os-services => generated 791 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 21:26:28.155212 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-e9c8653f-2f3d-4b7c-962f-5d74195fdeb6 admin admin] Calling method '>' {{(pid=83313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:26:28.156213 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-e9c8653f-2f3d-4b7c-962f-5d74195fdeb6 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 May 03 21:26:28.156664 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: [pid: 83313|app: 0|req: 33/67] 10.222.0.48 () {56 vars in 1074 bytes} [Tue May 3 21:26:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:26:28.388135 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-2ba7a3e0-3820-4eb2-892a-c93bece487be admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:26:28.393864 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:26:28.393864 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: warnings.warn(msg) May 03 21:26:28.395311 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG oslo_concurrency.lockutils [None req-2ba7a3e0-3820-4eb2-892a-c93bece487be admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:26:28.395747 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG oslo_concurrency.lockutils [None req-2ba7a3e0-3820-4eb2-892a-c93bece487be admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=83314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:26:28.396559 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG oslo_concurrency.lockutils [None req-2ba7a3e0-3820-4eb2-892a-c93bece487be admin admin] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:26:28.397396 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG oslo_concurrency.lockutils [None req-2ba7a3e0-3820-4eb2-892a-c93bece487be admin admin] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=83314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:26:28.425713 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.requestlog [None req-2ba7a3e0-3820-4eb2-892a-c93bece487be admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.87 time: 0.130797 May 03 21:26:28.426275 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: [pid: 83314|app: 0|req: 35/68] 10.222.0.48 () {60 vars in 1193 bytes} [Tue May 3 21:26:28 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:26:29.783724 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-e9c8653f-2f3d-4b7c-962f-5d74195fdeb6 admin admin] Calling method '>' {{(pid=83313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:26:29.784748 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-e9c8653f-2f3d-4b7c-962f-5d74195fdeb6 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 May 03 21:26:29.785153 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: [pid: 83313|app: 0|req: 34/69] 10.222.0.48 () {56 vars in 1074 bytes} [Tue May 3 21:26:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:26:29.999796 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG nova.api.openstack.wsgi [None req-d78f9c60-074b-4ca7-843c-4193622bc700 admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:26:30.005487 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:26:30.005487 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: warnings.warn(msg) May 03 21:26:30.007032 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG oslo_concurrency.lockutils [None req-d78f9c60-074b-4ca7-843c-4193622bc700 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:26:30.007469 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG oslo_concurrency.lockutils [None req-d78f9c60-074b-4ca7-843c-4193622bc700 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=83314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:26:30.008247 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG oslo_concurrency.lockutils [None req-d78f9c60-074b-4ca7-843c-4193622bc700 admin admin] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:26:30.008691 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: DEBUG oslo_concurrency.lockutils [None req-d78f9c60-074b-4ca7-843c-4193622bc700 admin admin] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=83314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:26:30.034914 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: INFO nova.api.openstack.requestlog [None req-d78f9c60-074b-4ca7-843c-4193622bc700 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.87 time: 0.114171 May 03 21:26:30.035480 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: [pid: 83314|app: 0|req: 36/70] 10.222.0.48 () {60 vars in 1193 bytes} [Tue May 3 21:26:29 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:27:27.445887 dv-cinder-840377-1-iscsi devstack@n-api.service[83312]: Tue May 3 21:27:27 2022 - graceful shutdown triggered... May 03 21:27:27.446019 dv-cinder-840377-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 03 21:27:27.446828 dv-cinder-840377-1-iscsi devstack@n-api.service[83313]: Gracefully killing worker 1 (pid: 83313)... May 03 21:27:27.447194 dv-cinder-840377-1-iscsi devstack@n-api.service[83314]: Gracefully killing worker 2 (pid: 83314)... May 03 21:27:28.447825 dv-cinder-840377-1-iscsi devstack@n-api.service[83312]: worker 1 buried after 1 seconds May 03 21:27:28.447825 dv-cinder-840377-1-iscsi devstack@n-api.service[83312]: worker 2 buried after 1 seconds May 03 21:27:28.447825 dv-cinder-840377-1-iscsi devstack@n-api.service[83312]: goodbye to uWSGI. May 03 21:27:28.449413 dv-cinder-840377-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 03 21:27:28.449982 dv-cinder-840377-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 03 21:27:28.452792 dv-cinder-840377-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 03 21:27:28.463835 dv-cinder-840377-1-iscsi devstack@n-api.service[97814]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 03 21:27:28.465876 dv-cinder-840377-1-iscsi devstack@n-api.service[97814]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 3 21:27:28 2022] *** May 03 21:27:28.465876 dv-cinder-840377-1-iscsi devstack@n-api.service[97814]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 03 21:27:28.465876 dv-cinder-840377-1-iscsi devstack@n-api.service[97814]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 03 21:27:28.465876 dv-cinder-840377-1-iscsi devstack@n-api.service[97814]: nodename: dv-cinder-840377-1-iscsi May 03 21:27:28.465876 dv-cinder-840377-1-iscsi devstack@n-api.service[97814]: machine: x86_64 May 03 21:27:28.465876 dv-cinder-840377-1-iscsi devstack@n-api.service[97814]: clock source: unix May 03 21:27:28.465876 dv-cinder-840377-1-iscsi devstack@n-api.service[97814]: pcre jit disabled May 03 21:27:28.465876 dv-cinder-840377-1-iscsi devstack@n-api.service[97814]: detected number of CPU cores: 4 May 03 21:27:28.465876 dv-cinder-840377-1-iscsi devstack@n-api.service[97814]: current working directory: / May 03 21:27:28.465876 dv-cinder-840377-1-iscsi devstack@n-api.service[97814]: detected binary path: /usr/bin/uwsgi-core May 03 21:27:28.465876 dv-cinder-840377-1-iscsi devstack@n-api.service[97814]: your processes number limit is 47680 May 03 21:27:28.466586 dv-cinder-840377-1-iscsi devstack@n-api.service[97814]: your memory page size is 4096 bytes May 03 21:27:28.466586 dv-cinder-840377-1-iscsi devstack@n-api.service[97814]: detected max file descriptor number: 2048 May 03 21:27:28.466586 dv-cinder-840377-1-iscsi devstack@n-api.service[97814]: lock engine: pthread robust mutexes May 03 21:27:28.466586 dv-cinder-840377-1-iscsi devstack@n-api.service[97814]: thunder lock: enabled May 03 21:27:28.466586 dv-cinder-840377-1-iscsi devstack@n-api.service[97814]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 03 21:27:28.466586 dv-cinder-840377-1-iscsi devstack@n-api.service[97814]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 03 21:27:28.510830 dv-cinder-840377-1-iscsi devstack@n-api.service[97814]: Python main interpreter initialized at 0x558a9860c9c0 May 03 21:27:28.510830 dv-cinder-840377-1-iscsi devstack@n-api.service[97814]: python threads support enabled May 03 21:27:28.510830 dv-cinder-840377-1-iscsi devstack@n-api.service[97814]: your server socket listen backlog is limited to 100 connections May 03 21:27:28.510830 dv-cinder-840377-1-iscsi devstack@n-api.service[97814]: your mercy for graceful operations on workers is 90 seconds May 03 21:27:28.511233 dv-cinder-840377-1-iscsi devstack@n-api.service[97814]: mapped 403077 bytes (393 KB) for 2 cores May 03 21:27:28.511316 dv-cinder-840377-1-iscsi devstack@n-api.service[97814]: *** Operational MODE: preforking *** May 03 21:27:28.511574 dv-cinder-840377-1-iscsi devstack@n-api.service[97814]: *** uWSGI is running in multiple interpreter mode *** May 03 21:27:28.511574 dv-cinder-840377-1-iscsi devstack@n-api.service[97814]: spawned uWSGI master process (pid: 97814) May 03 21:27:28.511781 dv-cinder-840377-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 03 21:27:28.515245 dv-cinder-840377-1-iscsi devstack@n-api.service[97814]: spawned uWSGI worker 1 (pid: 97831, cores: 1) May 03 21:27:28.515245 dv-cinder-840377-1-iscsi devstack@n-api.service[97814]: spawned uWSGI worker 2 (pid: 97832, cores: 1) May 03 21:27:28.515245 dv-cinder-840377-1-iscsi devstack@n-api.service[97814]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 03 21:27:32.603617 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 03 21:27:32.604365 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 03 21:27:32.604365 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 03 21:27:32.604757 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 03 21:27:32.604959 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 03 21:27:32.605347 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.605678 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.606004 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] bandwidth_poll_interval = 600 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.606340 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] bindir = /usr/local/bin {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.606664 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.606983 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.607313 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.607625 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.607953 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.608327 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.608700 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.608891 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.620394 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.620394 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840377-1-iscsi {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.620394 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.620394 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.620394 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.620394 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.620394 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.620394 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.621062 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.621062 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.621062 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.621062 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.621062 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.621062 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.621477 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.621477 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.621477 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.621477 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.621477 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.621477 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.621477 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840377-1-iscsi {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.621477 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.622014 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.622014 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.622014 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.622014 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.622014 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.622014 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.622014 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.622014 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.622542 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.622542 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.622542 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.622542 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.622542 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.622542 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.622542 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.622542 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.623120 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.623120 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.623120 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.623120 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.623388 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.623982 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.624093 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.624271 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.624552 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.624880 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.625204 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.625512 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.627225 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.627225 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.627225 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.627903 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.627903 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.628186 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.628349 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.628611 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.628938 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.629267 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.629577 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.629897 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.630306 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.630561 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.630873 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.631214 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.631536 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.631845 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.632165 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.632510 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.632825 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.633136 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.633450 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.633771 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.634090 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.634396 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.634636 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.635077 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.635275 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.635893 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.635893 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.636249 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.636916 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.636916 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.637221 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.637468 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.637777 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.638091 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.638474 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.638689 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.639043 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.639287 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.639600 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.639924 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.640263 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.640595 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.640903 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.641208 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.641516 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.641834 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.642169 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.642478 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.642801 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.643108 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.643413 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.643733 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.644042 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.644348 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.644690 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.644989 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.645296 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.645615 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.645922 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.646229 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.646533 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.646836 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.647141 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.647444 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.647745 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.648055 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.648352 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.648697 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.649023 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.706599 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.706599 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.706599 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.706599 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.706599 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.706599 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.706599 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.706599 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.707484 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.707484 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.707484 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.707484 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.707484 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.707484 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.707484 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.707484 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.708162 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.708162 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.708162 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.708162 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.708162 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.708162 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.708162 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.708162 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.708965 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.708965 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.708965 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.708965 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.708965 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.708965 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.708965 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.708965 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.709746 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.709746 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.709746 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.709746 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.709746 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.709746 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.709746 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.709746 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.710422 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.710422 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.710422 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.710422 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.710422 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.710422 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.710422 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.710422 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.710996 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.710996 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.710996 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.710996 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.710996 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.710996 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.710996 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.710996 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.711602 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.711602 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.711602 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.711602 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.711602 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.711602 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.711602 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.711602 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.712213 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.712213 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.712213 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.712213 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.712213 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.712213 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.712213 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.712213 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.712826 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.712826 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.712826 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.712826 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.712826 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.712826 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.712826 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.712826 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.713421 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.713421 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.713421 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.713421 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.713421 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.713421 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.713421 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.713421 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.714046 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.714046 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.714046 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.714046 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.714046 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.714046 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.714046 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.714046 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.714654 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.714654 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.714654 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.714654 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.714654 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.714654 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.714654 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.714654 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.715237 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.715237 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.715237 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.715237 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.715237 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.715237 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.715237 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.715237 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.715824 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.715824 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.715824 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.715824 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.715824 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.715824 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.715824 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.715824 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.716411 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.716411 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.716411 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.716411 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.716411 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.716411 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.716411 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.716411 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.717752 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.717752 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.717752 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.717752 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.717752 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.717752 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.717752 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.717752 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.718342 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.718342 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.718342 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.718342 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.718342 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.718342 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.718342 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.718342 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.718912 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.718912 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.718912 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.718912 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.718912 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.718912 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.718912 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.718912 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.719561 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.719561 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.719561 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.719561 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.719561 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.719561 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.719561 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.719561 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.720182 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.720182 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.720182 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.720182 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.720182 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.720182 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.720182 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.720182 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.721274 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.721274 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.721274 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.721274 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.721274 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.721274 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.721274 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.721274 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.721976 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.721976 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.721976 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.721976 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.721976 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.721976 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.721976 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.721976 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.722549 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.722549 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.722549 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.722549 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.722549 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.722549 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.722549 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.722549 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.723143 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.723143 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.723143 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.723143 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.723143 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.723143 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.723143 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.723143 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.723727 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.723727 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.723727 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.723727 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.723727 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.723727 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.723727 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.723727 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.724282 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.724282 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.724282 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.724282 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.724282 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.724282 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.724282 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.724282 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.724917 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.724917 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.724917 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.724917 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.724917 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.724917 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.724917 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.724917 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.725519 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.725519 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.725519 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.725519 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.725519 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.725519 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.725519 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.725519 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.726102 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.726102 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.726102 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.726102 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.726102 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.726102 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.726102 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.726102 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.726898 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.726898 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.726898 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.726898 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.726898 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.726898 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.726898 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.726898 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.727528 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.727528 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.727692 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.727905 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.728209 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.728551 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.728861 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.729171 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.729577 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.729904 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.730226 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.730536 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.730852 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.731162 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.731471 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.731779 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.732094 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.732415 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.732745 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.733052 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.733539 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.733867 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.734198 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.734514 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.734824 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.735135 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.735442 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.736363 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.736716 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.737084 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.737396 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.737716 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.738039 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.738358 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.738734 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.738983 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.739297 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.739735 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.739915 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.740241 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.740636 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.740902 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.741216 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.741539 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.741952 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.742282 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.742593 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.742906 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.743221 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.743533 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.744103 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.744412 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.744751 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.745069 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.745383 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.745698 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.746012 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.746323 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.746636 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.746949 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.747256 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.747746 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.747920 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.748194 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.748534 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.748845 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.749168 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.749473 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.749915 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.750229 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.750543 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.750851 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.751165 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.751518 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.752354 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.752728 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.753038 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.753458 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.753775 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.754090 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.754404 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.754712 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.755018 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.755330 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.755654 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.755960 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.756267 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.756597 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.756922 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.757230 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.757552 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.758064 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.758291 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.758585 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.759002 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.759325 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.759635 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.759962 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.760284 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.760634 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.760944 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.761260 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.761576 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.761889 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.762226 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.763112 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.763112 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.763346 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.763475 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.763813 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.764120 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.764633 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.764845 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.765253 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.765580 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.765893 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.766217 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.766543 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.766871 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.767292 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.767625 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.767939 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.768241 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.768577 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.768946 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.769251 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.769570 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.770137 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.770407 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.770539 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.770993 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.771269 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.771580 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.771755 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 03 21:27:32.772319 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.772417 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 03 21:27:32.772540 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.772636 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 03 21:27:32.772894 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.772894 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.773352 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 03 21:27:32.773352 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 03 21:27:32.773542 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.773542 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.773694 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.773764 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.773841 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.774161 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.774305 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] bandwidth_poll_interval = 600 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.774402 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.774507 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] bindir = /usr/local/bin {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.774894 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.775051 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.775139 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.775222 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.775386 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.775499 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.775648 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.775861 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.776015 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.776171 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.776415 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.776530 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.776739 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.776855 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.777060 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.777182 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.777396 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.777501 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.777701 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840377-1-iscsi {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.778019 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.778374 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.778484 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.778590 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.778662 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.778795 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.778970 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.779183 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.779324 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.779404 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.779482 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.779633 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.779721 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.779919 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.780005 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.780245 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.780381 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.780684 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.780786 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.780879 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.780971 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.781049 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.781127 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.781348 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.781440 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.781675 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.781767 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.781984 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.782075 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.782307 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.782409 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.782654 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.782771 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.783068 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.783239 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.783397 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.783563 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.783656 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.783915 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840377-1-iscsi {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.784005 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.784238 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.784330 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.784584 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.784686 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.784906 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.785119 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.785266 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.785367 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.785601 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.785704 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.785914 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.786007 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.786239 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.786339 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.786561 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.786661 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.786874 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.786971 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.787189 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.787276 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.787508 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.787606 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.787827 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.787925 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.788145 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.788237 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.788480 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.788582 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.788788 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.788877 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.789098 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.789192 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.789424 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.789529 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.789720 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.789825 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.790031 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.790382 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.790496 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.790582 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.790657 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.790897 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.790996 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.791223 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.791313 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.791535 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.791631 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.791796 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.791895 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.792052 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.792147 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.792379 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.792567 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.792749 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.792856 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.793063 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.793162 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.793378 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.793477 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.793688 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.793777 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.793996 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.794093 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.794310 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.794409 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.794622 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.794713 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.794932 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.795024 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.795245 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.795359 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.795567 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.795657 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.795880 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.795977 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.796203 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.796304 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.796539 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.796632 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.796864 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.796955 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.797197 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.797288 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.797504 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.797601 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.797817 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.797922 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.798135 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.798231 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.799023 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.799189 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.799402 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.799581 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.799709 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.799792 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.800048 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.800184 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.800357 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.800687 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.800883 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.800971 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.801050 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.801121 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.802012 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.802117 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.802198 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.802270 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.802270 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.802402 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.802483 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.802637 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.802713 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.802782 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.802859 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.802937 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.803075 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.803192 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.803386 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.803700 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.803778 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.804011 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.804100 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.804316 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.804397 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.804657 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.804738 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.805862 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.805981 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.806065 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.806152 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.806233 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.806315 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.806410 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.806495 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.806583 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.806672 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.806754 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.806848 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.806941 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.807031 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.807120 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.807203 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.807379 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.807526 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.807694 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.807795 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.808009 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.808115 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.808315 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.808413 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.809605 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.809709 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.809793 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.809866 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.809866 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.810070 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.810152 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.810297 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.810466 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.810541 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.810821 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.810911 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.811003 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.811081 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.811161 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.811243 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.811332 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.811422 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.811514 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.811685 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.811815 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.811996 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.812139 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.812305 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.812475 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.812653 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.812810 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.812968 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.813091 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.813274 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.813404 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.813582 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.813715 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.813897 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.814116 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.814807 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.814961 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.815133 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.815300 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.815459 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.815613 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.815771 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.815936 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.816101 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.816264 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.816416 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.816656 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.816751 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.816850 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.816941 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.817025 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.817223 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.817315 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.817529 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.817634 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.817835 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.817934 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.818140 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.818238 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 21:27:32.818446 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.818611 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.818766 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.818857 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.819072 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.819197 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.819385 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.819546 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.819735 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.819846 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.820079 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.820192 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.820287 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.820498 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.820626 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.820901 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.820997 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.821124 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.821226 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.821457 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.821555 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.821776 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.821869 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.822094 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.822197 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.822413 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.822510 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.822736 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.822832 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.823051 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.823152 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.823390 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.823488 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.823703 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.823940 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.824040 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.824266 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.824358 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.824660 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.824829 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.824987 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.825169 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.825321 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.825495 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.825647 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.825843 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.825962 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.826189 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.826309 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.826517 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.826659 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.826827 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.826979 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.827139 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.827309 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.827469 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.827637 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.827816 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.827956 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.828097 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.828295 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.828411 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.828631 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.828765 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.828940 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.829132 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.829299 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.829375 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.829620 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.829742 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.829920 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.830060 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.830304 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.830628 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.831011 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.831108 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.831282 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.831365 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.831609 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.831697 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.831937 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.832044 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.832248 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.832336 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.832609 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.832704 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.832945 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.833035 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.833267 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.833353 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.833660 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.833757 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.834134 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.834266 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.834511 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.834827 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.835137 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.835566 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.835886 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.836211 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.836559 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.836833 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.836924 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.837192 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.837284 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.837536 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.837624 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.837875 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.837976 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.838185 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.838281 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.838500 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.838588 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.838808 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.838896 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.839116 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.839210 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.839430 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.839511 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.839769 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.839870 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.840086 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.840181 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.840415 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.840536 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.840822 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.841202 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.841491 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.841695 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.841832 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.842017 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.842302 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.842440 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.842618 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.842830 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.842973 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.843256 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.843392 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.843570 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.843881 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.844027 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.844192 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.844420 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.844633 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.844833 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.845353 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.845575 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.845800 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.845992 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.846135 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.846283 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.846283 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.846543 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.846688 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.846824 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.846958 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.847103 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.847563 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.847671 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.847754 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.847953 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.848162 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.848317 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.848567 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.848726 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.848871 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.849039 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.849193 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.849344 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.849493 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.849637 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.849797 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.850013 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.850175 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.850327 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.850486 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.850710 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.850947 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.851130 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.851594 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.851756 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.851900 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.852052 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.852195 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.852195 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.852584 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.852745 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=97831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 03 21:27:32.852897 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.852897 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.853216 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.853440 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.853810 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.854188 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.854709 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.855030 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.855350 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.855670 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.856098 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.856447 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.856776 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.857101 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.857418 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.857956 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.858117 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.858363 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.858683 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.859040 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.859394 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.859728 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.860070 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.860414 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.861837 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.861837 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.862217 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.862497 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.862829 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.863164 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.863498 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.863830 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.864280 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.864735 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.865064 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.865397 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.865715 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.866074 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.866402 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.866736 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.867085 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.867411 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.867746 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.868075 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.868395 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.868985 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.869304 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.869626 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.869962 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.870283 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.871577 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.871577 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.871577 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.872302 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.872759 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.873241 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.873467 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.873814 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.874254 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.874587 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.874912 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.875240 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.875559 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.875872 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.876189 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.876588 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.877407 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.877735 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.878049 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.878376 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.878696 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.879128 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.879302 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.879623 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.879966 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.880493 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.880656 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.880938 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.881255 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.881754 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.882009 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.882458 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.882651 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.883220 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.883475 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.883934 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.884378 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.884726 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.885186 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.885699 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.885699 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.886003 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.886327 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.886647 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.886979 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.887306 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.887626 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.887948 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.888269 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.888680 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.888839 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_db.sqlalchemy.engines [None req-5607bfb1-317a-4575-b2ae-8b7f07acf543 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} May 03 21:27:32.889012 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.889360 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.889740 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.890135 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.890471 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.890698 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.891018 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.891350 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.891942 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.892684 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.893124 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.893705 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.894202 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.894541 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.894886 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.895231 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.895560 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.895881 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.896211 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.896554 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.896871 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.897204 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.897520 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.897838 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.898152 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.898473 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.898794 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.899095 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.899406 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.899718 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.900043 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.900355 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.900707 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.901016 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.901348 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.901666 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.902049 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.902288 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.902767 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.902973 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.903288 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.903639 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.903979 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.904328 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.904674 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.904985 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.905317 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.905630 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.905939 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.906263 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.906583 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.906889 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.907275 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.907595 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.908573 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.909065 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.909583 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.909914 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.910245 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.910563 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.910881 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.911221 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.911545 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.911866 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.912239 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.912520 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.912978 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.913139 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.913451 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.913763 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.914077 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.914398 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.914724 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.915046 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.915358 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.915679 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.915994 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.916309 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.916655 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.916971 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.917281 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.917592 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.917903 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.918213 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.918523 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.918854 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.919175 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.919485 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.919798 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.922669 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.922669 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.922669 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.922669 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.922669 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.922669 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.922669 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.925133 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.925133 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.925133 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.925133 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.925133 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.925133 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.925968 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.925968 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.925968 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.926367 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.926616 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.926950 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.927284 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.927598 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.927920 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.928244 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.928590 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.928912 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.929275 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.929762 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.930182 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.930512 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.930835 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.931157 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.931476 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.931796 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.932117 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.932795 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.932795 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.933139 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.933592 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.933743 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.934008 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.934330 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.934641 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.935187 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.935419 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.935742 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.936059 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.936381 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.936889 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.937111 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.938011 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.938224 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.938663 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.939046 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.939430 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.939722 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.940038 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.940352 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.940703 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.941041 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.941356 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.941670 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.941985 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.942317 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.942677 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.943074 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.943372 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.943704 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.944003 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.944447 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.944773 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.945081 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.945417 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.945745 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.946078 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.946393 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.946722 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.947045 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.947366 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.947699 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.948030 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.948349 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.948703 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.949019 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.949353 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.949685 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.950006 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.950335 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.950759 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.951091 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.951408 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.951736 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.952069 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.952404 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.952779 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.953194 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.953416 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.953746 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.954077 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.954366 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.954726 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.955055 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.955457 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.955688 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.956002 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.956316 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.956678 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.956992 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.957329 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.957634 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.957965 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.958296 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.958610 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.958938 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.959255 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.959566 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.959877 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.960190 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.960568 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.960883 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.961216 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.961556 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.961893 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.962211 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.962669 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.962923 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.963309 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.963545 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.963879 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.964202 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.964540 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.964864 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.965176 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.965567 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.965803 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.966122 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.966433 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.966750 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.967063 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.967432 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.967697 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.968024 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.968341 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.968677 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.968989 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.969300 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.969649 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.969963 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.970840 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.971175 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.971679 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.972023 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.972346 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.972719 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.973053 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.973428 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.973695 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.974022 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.974338 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.974657 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.974980 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.975289 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.975684 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.975935 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.976265 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.976873 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.977577 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.977577 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.977863 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.978175 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.978498 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.978820 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.979140 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.979461 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.979782 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.980103 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.980419 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.980797 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.981138 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.981478 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.981827 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.982154 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.982476 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.982797 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.983546 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.983773 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.984112 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.984474 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.984779 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.985359 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.985661 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.986604 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.987045 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.987369 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.987703 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.988031 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.988356 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.988802 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.989130 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.989578 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.989938 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.990273 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.990693 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.991022 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.991347 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.991897 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.992224 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.992593 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.992932 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.993269 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.993671 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.994167 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.994559 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.994794 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.995106 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.995499 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.995739 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.996053 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.996371 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.996718 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.997037 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.997365 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.997687 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.998231 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.998588 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.998910 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.999240 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.999573 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:32.999895 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.000297 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.000627 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.000944 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.001257 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.001668 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.001994 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.002493 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.002812 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.003136 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.003462 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.003854 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.004078 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.004390 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.004772 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.005116 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.005391 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.005705 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.006023 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.006335 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.006644 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.006963 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.007274 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.007593 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.007981 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.008221 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.008557 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.008879 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.009190 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.009507 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.009817 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.010173 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.010524 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.010986 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.011178 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.011423 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.011755 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.012206 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.012396 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.013032 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.013354 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.013946 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.014257 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.014589 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.014949 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.015301 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.015634 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.015954 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.016376 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.016631 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.016962 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.017381 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.017704 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.018100 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.018348 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.018670 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.018990 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.019309 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.019629 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.019946 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.020269 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.020727 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.021114 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.021451 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.021781 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.022171 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.022498 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.022819 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.023140 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.023458 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.023785 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.024162 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.024447 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.024779 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.025219 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.025543 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.025874 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.026205 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.026556 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.026860 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.027271 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.027710 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.027959 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.028282 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.028623 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.028940 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.029700 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.029700 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.030053 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.030208 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.030525 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.030860 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.031438 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.031777 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.032111 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.032458 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.033451 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.033876 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.034379 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.034379 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.034690 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.034983 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.035358 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.035635 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.035944 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.036283 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.036706 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.036973 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.037308 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.037639 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.037967 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.038336 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.038619 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.038938 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.039263 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.039582 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.039902 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.040225 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.040573 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.040911 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.041374 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.041580 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.041917 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.042273 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.042602 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.042951 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.043285 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 21:27:33.043534 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=97832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 03 21:27:33.084943 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_db.sqlalchemy.engines [None req-44fa4736-03ce-4f06-8260-fdae110282a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} May 03 21:27:33.136663 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.context [None req-5607bfb1-317a-4575-b2ae-8b7f07acf543 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3(cell1) {{(pid=97831) load_cells /opt/stack/nova/nova/context.py:465}} May 03 21:27:33.140900 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5607bfb1-317a-4575-b2ae-8b7f07acf543 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:27:33.142574 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5607bfb1-317a-4575-b2ae-8b7f07acf543 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:27:33.143383 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5607bfb1-317a-4575-b2ae-8b7f07acf543 None None] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:27:33.145381 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5607bfb1-317a-4575-b2ae-8b7f07acf543 None None] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:27:33.172273 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_db.sqlalchemy.engines [None req-5607bfb1-317a-4575-b2ae-8b7f07acf543 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} May 03 21:27:33.173570 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_db.sqlalchemy.engines [None req-5607bfb1-317a-4575-b2ae-8b7f07acf543 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} May 03 21:27:33.203773 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_db.sqlalchemy.engines [None req-5607bfb1-317a-4575-b2ae-8b7f07acf543 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} May 03 21:27:33.344676 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.context [None req-44fa4736-03ce-4f06-8260-fdae110282a1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3(cell1) {{(pid=97832) load_cells /opt/stack/nova/nova/context.py:465}} May 03 21:27:33.350472 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-44fa4736-03ce-4f06-8260-fdae110282a1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:27:33.352191 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-44fa4736-03ce-4f06-8260-fdae110282a1 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:27:33.353084 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-44fa4736-03ce-4f06-8260-fdae110282a1 None None] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:27:33.355127 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-44fa4736-03ce-4f06-8260-fdae110282a1 None None] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:27:33.381464 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_db.sqlalchemy.engines [None req-44fa4736-03ce-4f06-8260-fdae110282a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} May 03 21:27:33.386892 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_db.sqlalchemy.engines [None req-44fa4736-03ce-4f06-8260-fdae110282a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} May 03 21:27:33.414302 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_db.sqlalchemy.engines [None req-44fa4736-03ce-4f06-8260-fdae110282a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} May 03 21:27:33.439977 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO keyring.backend [None req-5607bfb1-317a-4575-b2ae-8b7f07acf543 None None] Loading KWallet May 03 21:27:33.449045 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO keyring.backend [None req-5607bfb1-317a-4575-b2ae-8b7f07acf543 None None] Loading SecretService May 03 21:27:33.452966 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO keyring.backend [None req-5607bfb1-317a-4575-b2ae-8b7f07acf543 None None] Loading Windows May 03 21:27:33.455363 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO keyring.backend [None req-5607bfb1-317a-4575-b2ae-8b7f07acf543 None None] Loading chainer May 03 21:27:33.456151 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO keyring.backend [None req-5607bfb1-317a-4575-b2ae-8b7f07acf543 None None] Loading macOS May 03 21:27:33.659217 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO keyring.backend [None req-44fa4736-03ce-4f06-8260-fdae110282a1 None None] Loading KWallet May 03 21:27:33.668506 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO keyring.backend [None req-44fa4736-03ce-4f06-8260-fdae110282a1 None None] Loading SecretService May 03 21:27:33.672617 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO keyring.backend [None req-44fa4736-03ce-4f06-8260-fdae110282a1 None None] Loading Windows May 03 21:27:33.674714 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO keyring.backend [None req-44fa4736-03ce-4f06-8260-fdae110282a1 None None] Loading chainer May 03 21:27:33.675510 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO keyring.backend [None req-44fa4736-03ce-4f06-8260-fdae110282a1 None None] Loading macOS May 03 21:27:33.712494 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: WARNING keystonemiddleware.auth_token [None req-5607bfb1-317a-4575-b2ae-8b7f07acf543 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 03 21:27:33.719172 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: WARNING keystonemiddleware.auth_token [None req-5607bfb1-317a-4575-b2ae-8b7f07acf543 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 03 21:27:33.930949 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: WARNING keystonemiddleware.auth_token [None req-5607bfb1-317a-4575-b2ae-8b7f07acf543 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 03 21:27:33.935931 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: WARNING keystonemiddleware.auth_token [None req-44fa4736-03ce-4f06-8260-fdae110282a1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 03 21:27:33.936418 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: WARNING keystonemiddleware.auth_token [None req-5607bfb1-317a-4575-b2ae-8b7f07acf543 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 03 21:27:33.941878 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558a9860c9c0 pid: 97831 (default app) May 03 21:27:33.943325 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: WARNING keystonemiddleware.auth_token [None req-44fa4736-03ce-4f06-8260-fdae110282a1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 03 21:27:34.161620 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: WARNING keystonemiddleware.auth_token [None req-44fa4736-03ce-4f06-8260-fdae110282a1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 03 21:27:34.167003 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: WARNING keystonemiddleware.auth_token [None req-44fa4736-03ce-4f06-8260-fdae110282a1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 03 21:27:34.172052 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558a9860c9c0 pid: 97832 (default app) May 03 21:28:24.774868 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-3b654bf4-f118-4f18-a525-ec8b2d9530c6 tempest-VolumesGetTestJSON-1829350822 tempest-VolumesGetTestJSON-1829350822-project] Action: 'create', calling method: .version_select at 0x7fc84d187d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-564372218", "metadata": {"Type": "work"}}} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:28:26.697129 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-3b654bf4-f118-4f18-a525-ec8b2d9530c6 tempest-VolumesGetTestJSON-1829350822 tempest-VolumesGetTestJSON-1829350822-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.594023 May 03 21:28:26.697129 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 1/1] 10.222.0.48 () {60 vars in 1155 bytes} [Tue May 3 21:28:23 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3598 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 03 21:28:27.231461 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-c7f0bb7f-b7a7-4d30-9497-bb3a4ce8e0a9 tempest-VolumesGetTestJSON-1829350822 tempest-VolumesGetTestJSON-1829350822-project] Calling method '.version_select at 0x7fc84d15a8b0>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:28:27.965338 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-c7f0bb7f-b7a7-4d30-9497-bb3a4ce8e0a9 tempest-VolumesGetTestJSON-1829350822 tempest-VolumesGetTestJSON-1829350822-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/65e7fc9b-0bda-4997-a06d-749c913a6cd5" status: 200 len: 353 microversion: 2.1 time: 1.264083 May 03 21:28:27.975526 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 1/2] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 3 21:28:26 2022] GET /compute/v2.1/os-volumes/65e7fc9b-0bda-4997-a06d-749c913a6cd5 => generated 353 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:28:27.989418 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-4074dc2f-58ff-4bf6-89bd-5a60229f719b tempest-VolumesGetTestJSON-1829350822 tempest-VolumesGetTestJSON-1829350822-project] Calling method '.version_select at 0x7fc84cfda040>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:28:28.182084 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-4074dc2f-58ff-4bf6-89bd-5a60229f719b tempest-VolumesGetTestJSON-1829350822 tempest-VolumesGetTestJSON-1829350822-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/65e7fc9b-0bda-4997-a06d-749c913a6cd5" status: 200 len: 353 microversion: 2.1 time: 0.205145 May 03 21:28:28.193275 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 3 21:28:27 2022] GET /compute/v2.1/os-volumes/65e7fc9b-0bda-4997-a06d-749c913a6cd5 => generated 353 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:28:28.216516 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-90b3b669-34d0-43d8-8c46-782872773fa8 tempest-VolumesGetTestJSON-1829350822 tempest-VolumesGetTestJSON-1829350822-project] Calling method '.version_select at 0x7fc84d045040>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:28:28.660247 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-90b3b669-34d0-43d8-8c46-782872773fa8 tempest-VolumesGetTestJSON-1829350822 tempest-VolumesGetTestJSON-1829350822-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/65e7fc9b-0bda-4997-a06d-749c913a6cd5" status: 202 len: 0 microversion: 2.1 time: 0.459861 May 03 21:28:28.661161 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1247 bytes} [Tue May 3 21:28:28 2022] DELETE /compute/v2.1/os-volumes/65e7fc9b-0bda-4997-a06d-749c913a6cd5 => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 21:28:28.674906 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-80a329a6-1c55-401f-b4e2-b2cdd4a05593 tempest-VolumesGetTestJSON-1829350822 tempest-VolumesGetTestJSON-1829350822-project] Calling method '.version_select at 0x7fc84cfda700>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:28:28.882836 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-80a329a6-1c55-401f-b4e2-b2cdd4a05593 tempest-VolumesGetTestJSON-1829350822 tempest-VolumesGetTestJSON-1829350822-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/65e7fc9b-0bda-4997-a06d-749c913a6cd5" status: 200 len: 352 microversion: 2.1 time: 0.217412 May 03 21:28:28.883647 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 3/5] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 3 21:28:28 2022] GET /compute/v2.1/os-volumes/65e7fc9b-0bda-4997-a06d-749c913a6cd5 => generated 352 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:28:29.003666 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-138e1955-7f54-4e4a-8528-c37ff6fb7970 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1918983663", "imageRef": "f5214328-64f1-4aa6-aa05-61f0189e0e1e", "flavorRef": "452", "networks": [{"uuid": "556cc182-54d3-4ca5-af4a-8fbf93a97ff0"}]}} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:28:29.272356 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.network.neutron [None req-138e1955-7f54-4e4a-8528-c37ff6fb7970 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] validate_networks() for [('556cc182-54d3-4ca5-af4a-8fbf93a97ff0', None, None, None)] {{(pid=97832) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} May 03 21:28:29.908470 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-c9ae1fe1-50ad-464a-a165-072f75ba63a2 tempest-VolumesGetTestJSON-1829350822 tempest-VolumesGetTestJSON-1829350822-project] Calling method '.version_select at 0x7fc84cfdadc0>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:28:30.051901 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.wsgi [None req-c9ae1fe1-50ad-464a-a165-072f75ba63a2 tempest-VolumesGetTestJSON-1829350822 tempest-VolumesGetTestJSON-1829350822-project] HTTP exception thrown: Volume 65e7fc9b-0bda-4997-a06d-749c913a6cd5 could not be found. May 03 21:28:30.052730 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-c9ae1fe1-50ad-464a-a165-072f75ba63a2 tempest-VolumesGetTestJSON-1829350822 tempest-VolumesGetTestJSON-1829350822-project] Returning 404 to user: Volume 65e7fc9b-0bda-4997-a06d-749c913a6cd5 could not be found. {{(pid=97831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:28:30.053736 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-c9ae1fe1-50ad-464a-a165-072f75ba63a2 tempest-VolumesGetTestJSON-1829350822 tempest-VolumesGetTestJSON-1829350822-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/65e7fc9b-0bda-4997-a06d-749c913a6cd5" status: 404 len: 109 microversion: 2.1 time: 0.161969 May 03 21:28:30.054425 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 4/6] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 3 21:28:29 2022] GET /compute/v2.1/os-volumes/65e7fc9b-0bda-4997-a06d-749c913a6cd5 => generated 109 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 03 21:28:31.357320 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-138e1955-7f54-4e4a-8528-c37ff6fb7970 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Flavor limits 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} May 03 21:28:31.361745 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-138e1955-7f54-4e4a-8528-c37ff6fb7970 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Image limits 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} May 03 21:28:31.363072 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-138e1955-7f54-4e4a-8528-c37ff6fb7970 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Flavor pref 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} May 03 21:28:31.379627 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-138e1955-7f54-4e4a-8528-c37ff6fb7970 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Image pref 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} May 03 21:28:31.389610 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-138e1955-7f54-4e4a-8528-c37ff6fb7970 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} May 03 21:28:31.492090 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-138e1955-7f54-4e4a-8528-c37ff6fb7970 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:28:31.494624 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-138e1955-7f54-4e4a-8528-c37ff6fb7970 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:28:31.502048 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-138e1955-7f54-4e4a-8528-c37ff6fb7970 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:28:31.502930 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-138e1955-7f54-4e4a-8528-c37ff6fb7970 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:28:31.656154 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-138e1955-7f54-4e4a-8528-c37ff6fb7970 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Getting quotas for project a5ad2a8e2573405fa636364bdf765504. Resources: {'instances', 'ram', 'cores'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:28:31.673228 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-138e1955-7f54-4e4a-8528-c37ff6fb7970 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Getting quotas for user 22d5d87a502542b6b1215ad2f2531fe4 and project a5ad2a8e2573405fa636364bdf765504. Resources: {'instances', 'ram', 'cores'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:28:31.688211 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-138e1955-7f54-4e4a-8528-c37ff6fb7970 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Going to run 1 instances... {{(pid=97832) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} May 03 21:28:31.694919 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-138e1955-7f54-4e4a-8528-c37ff6fb7970 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] [instance: 7ae08669-d95f-432b-bc27-265833de050d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5214328-64f1-4aa6-aa05-61f0189e0e1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=97832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} May 03 21:28:31.897391 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-138e1955-7f54-4e4a-8528-c37ff6fb7970 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.017545 May 03 21:28:31.898041 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 3/7] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 3 21:28:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 3019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 03 21:28:31.923439 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-a7c01af8-731f-48fd-b9a8-faf9cae32a9a tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:28:31.926825 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-a7c01af8-731f-48fd-b9a8-faf9cae32a9a tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] [instance: 7ae08669-d95f-432b-bc27-265833de050d] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:28:32.411213 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-a7c01af8-731f-48fd-b9a8-faf9cae32a9a tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d5d87a502542b6b1215ad2f2531fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ad2a8e2573405fa636364bdf765504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:28:32.445510 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-a7c01af8-731f-48fd-b9a8-faf9cae32a9a tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] 10.222.0.48 "GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d" status: 200 len: 1215 microversion: 2.1 time: 0.540424 May 03 21:28:32.445871 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 5/8] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:28:31 2022] GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d => generated 1215 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:28:33.472999 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-db160d75-203f-4daa-b720-1a462eb9f9d0 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:28:33.480470 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-db160d75-203f-4daa-b720-1a462eb9f9d0 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] [instance: 7ae08669-d95f-432b-bc27-265833de050d] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:28:33.671739 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-db160d75-203f-4daa-b720-1a462eb9f9d0 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d5d87a502542b6b1215ad2f2531fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ad2a8e2573405fa636364bdf765504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:28:33.789197 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-db160d75-203f-4daa-b720-1a462eb9f9d0 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] 10.222.0.48 "GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d" status: 200 len: 1215 microversion: 2.1 time: 0.322822 May 03 21:28:33.794852 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 4/9] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:28:33 2022] GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d => generated 1215 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:28:34.818368 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-a8dd4b35-8a1e-42c2-a3ab-4ed4f4ceda77 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:28:34.819176 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-a8dd4b35-8a1e-42c2-a3ab-4ed4f4ceda77 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] [instance: 7ae08669-d95f-432b-bc27-265833de050d] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:28:35.121328 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-a8dd4b35-8a1e-42c2-a3ab-4ed4f4ceda77 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d5d87a502542b6b1215ad2f2531fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ad2a8e2573405fa636364bdf765504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:28:35.161967 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-a8dd4b35-8a1e-42c2-a3ab-4ed4f4ceda77 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] 10.222.0.48 "GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d" status: 200 len: 1215 microversion: 2.1 time: 0.344019 May 03 21:28:35.161967 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 6/10] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:28:34 2022] GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d => generated 1215 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:28:36.181140 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-08d95a7b-d48c-412e-87fe-aab1aecff816 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:28:36.196792 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-08d95a7b-d48c-412e-87fe-aab1aecff816 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] [instance: 7ae08669-d95f-432b-bc27-265833de050d] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:28:36.227148 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-08d95a7b-d48c-412e-87fe-aab1aecff816 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:28:36.231124 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-08d95a7b-d48c-412e-87fe-aab1aecff816 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:28:36.233348 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-08d95a7b-d48c-412e-87fe-aab1aecff816 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:28:36.237749 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-08d95a7b-d48c-412e-87fe-aab1aecff816 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:28:36.944578 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-08d95a7b-d48c-412e-87fe-aab1aecff816 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d5d87a502542b6b1215ad2f2531fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ad2a8e2573405fa636364bdf765504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:28:36.972878 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-08d95a7b-d48c-412e-87fe-aab1aecff816 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] 10.222.0.48 "GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d" status: 200 len: 1219 microversion: 2.1 time: 0.805113 May 03 21:28:36.988848 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 5/11] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:28:36 2022] GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d => generated 1219 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:28:38.003400 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-1fd97e4c-feb7-47ca-ae89-1a551245722c tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:28:38.007970 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-1fd97e4c-feb7-47ca-ae89-1a551245722c tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] [instance: 7ae08669-d95f-432b-bc27-265833de050d] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:28:38.023883 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1fd97e4c-feb7-47ca-ae89-1a551245722c tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:28:38.024356 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1fd97e4c-feb7-47ca-ae89-1a551245722c tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:28:38.027351 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1fd97e4c-feb7-47ca-ae89-1a551245722c tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:28:38.027792 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1fd97e4c-feb7-47ca-ae89-1a551245722c tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:28:38.503026 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-1fd97e4c-feb7-47ca-ae89-1a551245722c tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d5d87a502542b6b1215ad2f2531fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ad2a8e2573405fa636364bdf765504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:28:38.537495 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-1fd97e4c-feb7-47ca-ae89-1a551245722c tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] 10.222.0.48 "GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d" status: 200 len: 1267 microversion: 2.1 time: 0.546205 May 03 21:28:38.543415 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 7/12] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:28:37 2022] GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d => generated 1267 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:28:39.567882 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-dbb5b0d3-1695-4748-b4a2-c42c5373cafb tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:28:39.577056 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-dbb5b0d3-1695-4748-b4a2-c42c5373cafb tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] [instance: 7ae08669-d95f-432b-bc27-265833de050d] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:28:39.597044 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-dbb5b0d3-1695-4748-b4a2-c42c5373cafb tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:28:39.597908 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-dbb5b0d3-1695-4748-b4a2-c42c5373cafb tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:28:39.602783 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-dbb5b0d3-1695-4748-b4a2-c42c5373cafb tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:28:39.603513 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-dbb5b0d3-1695-4748-b4a2-c42c5373cafb tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:28:40.082688 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-dbb5b0d3-1695-4748-b4a2-c42c5373cafb tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d5d87a502542b6b1215ad2f2531fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ad2a8e2573405fa636364bdf765504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:28:40.114276 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-dbb5b0d3-1695-4748-b4a2-c42c5373cafb tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] 10.222.0.48 "GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d" status: 200 len: 1285 microversion: 2.1 time: 0.548165 May 03 21:28:40.115119 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 6/13] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:28:39 2022] GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d => generated 1285 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:28:40.948312 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-1af9e95b-3de2-4694-b47f-680d7adfc52f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-262996089", "imageRef": "f5214328-64f1-4aa6-aa05-61f0189e0e1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:28:41.139945 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-941eb6ce-ac5c-4b3c-9363-4f6dfc94e0b0 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:28:41.142626 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-941eb6ce-ac5c-4b3c-9363-4f6dfc94e0b0 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] [instance: 7ae08669-d95f-432b-bc27-265833de050d] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:28:41.180514 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-941eb6ce-ac5c-4b3c-9363-4f6dfc94e0b0 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:28:41.180514 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-941eb6ce-ac5c-4b3c-9363-4f6dfc94e0b0 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:28:41.180514 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-941eb6ce-ac5c-4b3c-9363-4f6dfc94e0b0 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:28:41.180514 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-941eb6ce-ac5c-4b3c-9363-4f6dfc94e0b0 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:28:41.319069 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.network.neutron [None req-1af9e95b-3de2-4694-b47f-680d7adfc52f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] validate_networks() for [('5bd090d5-a93e-4f68-8601-6aad9d3eb473', None, None, None)] {{(pid=97831) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} May 03 21:28:41.876756 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-941eb6ce-ac5c-4b3c-9363-4f6dfc94e0b0 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d5d87a502542b6b1215ad2f2531fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ad2a8e2573405fa636364bdf765504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:28:41.901484 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-941eb6ce-ac5c-4b3c-9363-4f6dfc94e0b0 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] 10.222.0.48 "GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d" status: 200 len: 1273 microversion: 2.1 time: 0.772656 May 03 21:28:41.902315 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 7/14] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:28:41 2022] GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d => generated 1273 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:28:42.954553 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-7cb1ca13-0fe5-4cec-8464-1d253d7f822c tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:28:42.955241 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-7cb1ca13-0fe5-4cec-8464-1d253d7f822c tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] [instance: 7ae08669-d95f-432b-bc27-265833de050d] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:28:42.993591 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7cb1ca13-0fe5-4cec-8464-1d253d7f822c tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:28:42.994048 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7cb1ca13-0fe5-4cec-8464-1d253d7f822c tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:28:42.995103 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7cb1ca13-0fe5-4cec-8464-1d253d7f822c tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:28:42.995538 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7cb1ca13-0fe5-4cec-8464-1d253d7f822c tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:28:43.869950 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-7cb1ca13-0fe5-4cec-8464-1d253d7f822c tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d5d87a502542b6b1215ad2f2531fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ad2a8e2573405fa636364bdf765504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:28:43.894544 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-7cb1ca13-0fe5-4cec-8464-1d253d7f822c tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] 10.222.0.48 "GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d" status: 200 len: 1315 microversion: 2.1 time: 0.976722 May 03 21:28:43.910322 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 8/15] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:28:42 2022] GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d => generated 1315 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:28:44.825033 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-2c568c77-d529-4a0b-81c5-d9670fd41fd4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Action: 'create', calling method: .version_select at 0x7fc84ce88d30>, body: {"keypair": {"name": "tempest-keypair-1034276759"}} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:28:44.974535 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-2c568c77-d529-4a0b-81c5-d9670fd41fd4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Getting quotas for project bd571e41b44a4bc6b16bf8163252f168. Resources: {'key_pairs'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:28:44.983928 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-2c568c77-d529-4a0b-81c5-d9670fd41fd4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Getting quotas for user c2fe2da4d72e4522ac8bbb7c9a58381a and project bd571e41b44a4bc6b16bf8163252f168. Resources: {'key_pairs'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:28:46.956279 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-2c568c77-d529-4a0b-81c5-d9670fd41fd4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Getting quotas for project bd571e41b44a4bc6b16bf8163252f168. Resources: {'key_pairs'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:28:46.962619 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-2c568c77-d529-4a0b-81c5-d9670fd41fd4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Getting quotas for user c2fe2da4d72e4522ac8bbb7c9a58381a and project bd571e41b44a4bc6b16bf8163252f168. Resources: {'key_pairs'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:28:47.014605 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-2c568c77-d529-4a0b-81c5-d9670fd41fd4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 3.018577 May 03 21:28:47.022295 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 9/16] 10.222.0.48 () {60 vars in 1157 bytes} [Tue May 3 21:28:43 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 3030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:28:47.033869 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-999c824d-7a5d-4ee7-8893-f325ab28a6d9 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:28:47.034897 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-999c824d-7a5d-4ee7-8893-f325ab28a6d9 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] [instance: 7ae08669-d95f-432b-bc27-265833de050d] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:28:47.050788 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-999c824d-7a5d-4ee7-8893-f325ab28a6d9 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:28:47.051317 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-999c824d-7a5d-4ee7-8893-f325ab28a6d9 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:28:47.052103 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-999c824d-7a5d-4ee7-8893-f325ab28a6d9 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:28:47.052563 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-999c824d-7a5d-4ee7-8893-f325ab28a6d9 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:28:48.446470 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-999c824d-7a5d-4ee7-8893-f325ab28a6d9 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d5d87a502542b6b1215ad2f2531fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ad2a8e2573405fa636364bdf765504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:28:48.495586 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-999c824d-7a5d-4ee7-8893-f325ab28a6d9 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] 10.222.0.48 "GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d" status: 200 len: 1315 microversion: 2.1 time: 1.471775 May 03 21:28:48.500863 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 10/17] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:28:47 2022] GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d => generated 1315 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:28:49.024042 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-1af9e95b-3de2-4694-b47f-680d7adfc52f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Flavor limits 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} May 03 21:28:49.024609 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-1af9e95b-3de2-4694-b47f-680d7adfc52f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Image limits 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} May 03 21:28:49.024961 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-1af9e95b-3de2-4694-b47f-680d7adfc52f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Flavor pref 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} May 03 21:28:49.025535 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-1af9e95b-3de2-4694-b47f-680d7adfc52f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Image pref 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} May 03 21:28:49.026107 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-1af9e95b-3de2-4694-b47f-680d7adfc52f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} May 03 21:28:49.049844 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1af9e95b-3de2-4694-b47f-680d7adfc52f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:28:49.050462 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1af9e95b-3de2-4694-b47f-680d7adfc52f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:28:49.051652 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1af9e95b-3de2-4694-b47f-680d7adfc52f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:28:49.052232 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1af9e95b-3de2-4694-b47f-680d7adfc52f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:28:49.090769 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-1af9e95b-3de2-4694-b47f-680d7adfc52f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Getting quotas for project 30468ebc688d4bc1b036b4b984931e87. Resources: {'instances', 'ram', 'cores'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:28:49.096985 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-1af9e95b-3de2-4694-b47f-680d7adfc52f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Getting quotas for user 5a12cc655c2c404e928b2e1bb44c64e4 and project 30468ebc688d4bc1b036b4b984931e87. Resources: {'instances', 'ram', 'cores'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:28:49.109956 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-1af9e95b-3de2-4694-b47f-680d7adfc52f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Going to run 1 instances... {{(pid=97831) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} May 03 21:28:49.113149 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-1af9e95b-3de2-4694-b47f-680d7adfc52f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5214328-64f1-4aa6-aa05-61f0189e0e1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=97831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} May 03 21:28:49.439880 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-1af9e95b-3de2-4694-b47f-680d7adfc52f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 8.857554 May 03 21:28:49.442102 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 8/18] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 3 21:28:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 8860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 03 21:28:49.465108 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-111e30c8-0dbf-4181-b1a8-760326f5a23a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:28:49.467982 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-111e30c8-0dbf-4181-b1a8-760326f5a23a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:28:49.526451 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-2eaa727d-8b84-4833-80ea-8bcec9acfa42 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:28:49.527642 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-2eaa727d-8b84-4833-80ea-8bcec9acfa42 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] [instance: 7ae08669-d95f-432b-bc27-265833de050d] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:28:49.538753 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2eaa727d-8b84-4833-80ea-8bcec9acfa42 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:28:49.539706 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2eaa727d-8b84-4833-80ea-8bcec9acfa42 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:28:49.541664 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2eaa727d-8b84-4833-80ea-8bcec9acfa42 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:28:49.542348 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2eaa727d-8b84-4833-80ea-8bcec9acfa42 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:28:49.729650 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-111e30c8-0dbf-4181-b1a8-760326f5a23a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:28:49.761409 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-111e30c8-0dbf-4181-b1a8-760326f5a23a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9" status: 200 len: 1221 microversion: 2.1 time: 0.313514 May 03 21:28:49.769291 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 11/19] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:28:49 2022] GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9 => generated 1221 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:28:50.138205 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-90997344-f43a-4b33-9d8d-116b02038bd2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2099261181", "imageRef": "f5214328-64f1-4aa6-aa05-61f0189e0e1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:28:51.363168 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-2eaa727d-8b84-4833-80ea-8bcec9acfa42 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d5d87a502542b6b1215ad2f2531fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ad2a8e2573405fa636364bdf765504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:28:51.392627 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-2eaa727d-8b84-4833-80ea-8bcec9acfa42 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] 10.222.0.48 "GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d" status: 200 len: 1315 microversion: 2.1 time: 1.866665 May 03 21:28:51.392627 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 9/20] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:28:49 2022] GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d => generated 1315 bytes in 1871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:28:52.189247 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-80da320e-bd6c-4d93-9841-8ae6944542a9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Action: 'create', calling method: .version_select at 0x7fc84cebedc0>, body: {"keypair": {"name": "tempest-keypair-446845386"}} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:28:52.269327 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-80da320e-bd6c-4d93-9841-8ae6944542a9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Getting quotas for project a2df1ca790224a009004c3c22a5ee5c5. Resources: {'key_pairs'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:28:52.273817 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-80da320e-bd6c-4d93-9841-8ae6944542a9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Getting quotas for user 649d5374c0ae4842853cd3b425d1d6d2 and project a2df1ca790224a009004c3c22a5ee5c5. Resources: {'key_pairs'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:28:52.602310 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-80da320e-bd6c-4d93-9841-8ae6944542a9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Getting quotas for project a2df1ca790224a009004c3c22a5ee5c5. Resources: {'key_pairs'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:28:52.609640 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-80da320e-bd6c-4d93-9841-8ae6944542a9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Getting quotas for user 649d5374c0ae4842853cd3b425d1d6d2 and project a2df1ca790224a009004c3c22a5ee5c5. Resources: {'key_pairs'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:28:52.630289 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-80da320e-bd6c-4d93-9841-8ae6944542a9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 1.242252 May 03 21:28:52.631668 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 10/21] 10.222.0.48 () {60 vars in 1157 bytes} [Tue May 3 21:28:51 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:28:53.036385 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-7fda2324-1cfb-412d-bace-81cb680ef703 req-ebe1ae45-307e-4f6c-bf4e-38639fd7c951 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ae08669-d95f-432b-bc27-265833de050d", "tag": "99d8b720-a305-456d-805e-84e960517e14"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:28:53.090156 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:28:53.090156 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:28:53.122310 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-7fda2324-1cfb-412d-bace-81cb680ef703 req-ebe1ae45-307e-4f6c-bf4e-38639fd7c951 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:28:53.125943 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-7fda2324-1cfb-412d-bace-81cb680ef703 req-ebe1ae45-307e-4f6c-bf4e-38639fd7c951 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:28:53.206401 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-7fda2324-1cfb-412d-bace-81cb680ef703 req-ebe1ae45-307e-4f6c-bf4e-38639fd7c951 service nova] Creating event network-changed:99d8b720-a305-456d-805e-84e960517e14 for instance 7ae08669-d95f-432b-bc27-265833de050d on hv-cinder-84037 May 03 21:28:53.207067 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-7fda2324-1cfb-412d-bace-81cb680ef703 req-ebe1ae45-307e-4f6c-bf4e-38639fd7c951 service nova] Acquired lock "compute-rpcapi-router" {{(pid=97831) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} May 03 21:28:53.211921 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1036c1c7-0893-42df-b627-1d937493345e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:28:53.213169 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1036c1c7-0893-42df-b627-1d937493345e None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:28:53.215502 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1036c1c7-0893-42df-b627-1d937493345e None None] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:28:53.217492 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1036c1c7-0893-42df-b627-1d937493345e None None] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:28:53.248263 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.compute.rpcapi [None req-1036c1c7-0893-42df-b627-1d937493345e None None] Automatically selected compute RPC version 5.12 from minimum service version 53 May 03 21:28:53.249506 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1036c1c7-0893-42df-b627-1d937493345e None None] Releasing lock "compute-rpcapi-router" {{(pid=97831) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} May 03 21:28:53.315050 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-1036c1c7-0893-42df-b627-1d937493345e None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.681982 May 03 21:28:53.316726 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 11/22] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:28:53.664836 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-06019e0b-d6a6-476d-b70d-f53e9fc315fa tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Action: 'create', calling method: .version_select at 0x7fc84ce8a280>, body: {"keypair": {"name": "tempest-keypair-217153273"}} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:28:53.694870 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-06019e0b-d6a6-476d-b70d-f53e9fc315fa tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Getting quotas for project 4cf52ffb4a864a689f5d0242ddc4cc4f. Resources: {'key_pairs'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:28:53.701463 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-06019e0b-d6a6-476d-b70d-f53e9fc315fa tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Getting quotas for user 2f7bb76fefa8402db231ed466d351631 and project 4cf52ffb4a864a689f5d0242ddc4cc4f. Resources: {'key_pairs'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:28:54.650138 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.network.neutron [None req-90997344-f43a-4b33-9d8d-116b02038bd2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] validate_networks() for [('5bd090d5-a93e-4f68-8601-6aad9d3eb473', None, None, None)] {{(pid=97832) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} May 03 21:28:55.212739 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-06019e0b-d6a6-476d-b70d-f53e9fc315fa tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Getting quotas for project 4cf52ffb4a864a689f5d0242ddc4cc4f. Resources: {'key_pairs'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:28:55.217797 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-06019e0b-d6a6-476d-b70d-f53e9fc315fa tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Getting quotas for user 2f7bb76fefa8402db231ed466d351631 and project 4cf52ffb4a864a689f5d0242ddc4cc4f. Resources: {'key_pairs'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:28:55.257025 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-06019e0b-d6a6-476d-b70d-f53e9fc315fa tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 1.938958 May 03 21:28:55.257025 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 12/23] 10.222.0.48 () {62 vars in 1198 bytes} [Tue May 3 21:28:53 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1940 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) May 03 21:28:55.290619 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-09e33ebd-bf74-4742-981e-f35d3b300c07 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:28:55.292351 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-09e33ebd-bf74-4742-981e-f35d3b300c07 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] [instance: 7ae08669-d95f-432b-bc27-265833de050d] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:28:55.306471 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-09e33ebd-bf74-4742-981e-f35d3b300c07 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:28:55.307453 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-09e33ebd-bf74-4742-981e-f35d3b300c07 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:28:55.308772 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-09e33ebd-bf74-4742-981e-f35d3b300c07 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:28:55.309959 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-09e33ebd-bf74-4742-981e-f35d3b300c07 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:28:56.477566 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-90997344-f43a-4b33-9d8d-116b02038bd2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Flavor limits 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} May 03 21:28:56.479775 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-90997344-f43a-4b33-9d8d-116b02038bd2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Image limits 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} May 03 21:28:56.480567 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-90997344-f43a-4b33-9d8d-116b02038bd2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Flavor pref 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} May 03 21:28:56.484657 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-90997344-f43a-4b33-9d8d-116b02038bd2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Image pref 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} May 03 21:28:56.484912 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-90997344-f43a-4b33-9d8d-116b02038bd2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} May 03 21:28:56.499992 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-90997344-f43a-4b33-9d8d-116b02038bd2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:28:56.507044 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-90997344-f43a-4b33-9d8d-116b02038bd2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:28:56.508154 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-90997344-f43a-4b33-9d8d-116b02038bd2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:28:56.509706 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-90997344-f43a-4b33-9d8d-116b02038bd2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:28:56.570855 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-90997344-f43a-4b33-9d8d-116b02038bd2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Getting quotas for project 30468ebc688d4bc1b036b4b984931e87. Resources: {'instances', 'ram', 'cores'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:28:56.590653 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-90997344-f43a-4b33-9d8d-116b02038bd2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Getting quotas for user 5a12cc655c2c404e928b2e1bb44c64e4 and project 30468ebc688d4bc1b036b4b984931e87. Resources: {'instances', 'ram', 'cores'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:28:56.618817 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-90997344-f43a-4b33-9d8d-116b02038bd2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Going to run 1 instances... {{(pid=97832) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} May 03 21:28:56.623083 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-09e33ebd-bf74-4742-981e-f35d3b300c07 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d5d87a502542b6b1215ad2f2531fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ad2a8e2573405fa636364bdf765504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:28:56.627644 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-90997344-f43a-4b33-9d8d-116b02038bd2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5214328-64f1-4aa6-aa05-61f0189e0e1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=97832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} May 03 21:28:56.649981 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-09e33ebd-bf74-4742-981e-f35d3b300c07 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] 10.222.0.48 "GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d" status: 200 len: 1315 microversion: 2.1 time: 1.387998 May 03 21:28:56.651275 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 13/24] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:28:55 2022] GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d => generated 1315 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:28:56.882703 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-90997344-f43a-4b33-9d8d-116b02038bd2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.754132 May 03 21:28:56.884981 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 12/25] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 3 21:28:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 6757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 03 21:28:56.900707 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-6e80447a-0e5e-46b1-8f4f-af3602fedc6a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:28:56.905998 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-6e80447a-0e5e-46b1-8f4f-af3602fedc6a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:28:57.051232 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-6e80447a-0e5e-46b1-8f4f-af3602fedc6a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:28:57.095793 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-6e80447a-0e5e-46b1-8f4f-af3602fedc6a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1222 microversion: 2.1 time: 0.204907 May 03 21:28:57.096943 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 14/26] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:28:56 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1222 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:28:57.474920 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-e120477f-a51d-475e-b51b-ff293c2663e6 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-437292456", "imageRef": "f5214328-64f1-4aa6-aa05-61f0189e0e1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "afa29ce3-7ea1-4fb3-8d15-b28913382476"}], "security_groups": [{"name": "tempest-securitygroup--1506121425"}], "key_name": "tempest-keypair-1034276759", "user_data": "}} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:28:57.679792 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-6af92e9b-f800-4800-8e03-83f94c67f1f5 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:28:57.681153 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-6af92e9b-f800-4800-8e03-83f94c67f1f5 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] [instance: 7ae08669-d95f-432b-bc27-265833de050d] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:28:57.690035 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6af92e9b-f800-4800-8e03-83f94c67f1f5 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:28:57.690760 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6af92e9b-f800-4800-8e03-83f94c67f1f5 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:28:57.692363 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6af92e9b-f800-4800-8e03-83f94c67f1f5 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:28:57.693076 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6af92e9b-f800-4800-8e03-83f94c67f1f5 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:28:57.964769 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.network.neutron [None req-e120477f-a51d-475e-b51b-ff293c2663e6 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] validate_networks() for [('afa29ce3-7ea1-4fb3-8d15-b28913382476', None, None, None)] {{(pid=97832) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} May 03 21:28:58.042724 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-6af92e9b-f800-4800-8e03-83f94c67f1f5 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d5d87a502542b6b1215ad2f2531fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ad2a8e2573405fa636364bdf765504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:28:58.054716 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-6af92e9b-f800-4800-8e03-83f94c67f1f5 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] 10.222.0.48 "GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d" status: 200 len: 1315 microversion: 2.1 time: 0.387732 May 03 21:28:58.064709 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 15/27] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:28:57 2022] GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:28:58.130574 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-3422bf3f-c30f-4d59-b980-de89f1de3236 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:28:58.132681 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-3422bf3f-c30f-4d59-b980-de89f1de3236 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:28:58.320744 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-3422bf3f-c30f-4d59-b980-de89f1de3236 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:28:58.336834 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-3422bf3f-c30f-4d59-b980-de89f1de3236 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1222 microversion: 2.1 time: 0.221407 May 03 21:28:58.354586 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 16/28] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:28:58 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1222 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:28:59.080646 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-e8a1b422-79c3-4da1-8608-da279c5aa2f1 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:28:59.081340 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-e8a1b422-79c3-4da1-8608-da279c5aa2f1 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] [instance: 7ae08669-d95f-432b-bc27-265833de050d] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:28:59.099282 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e8a1b422-79c3-4da1-8608-da279c5aa2f1 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:28:59.101065 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e8a1b422-79c3-4da1-8608-da279c5aa2f1 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:28:59.102257 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e8a1b422-79c3-4da1-8608-da279c5aa2f1 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:28:59.102904 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e8a1b422-79c3-4da1-8608-da279c5aa2f1 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:28:59.516252 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-e120477f-a51d-475e-b51b-ff293c2663e6 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Flavor limits 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} May 03 21:28:59.516827 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-e120477f-a51d-475e-b51b-ff293c2663e6 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Image limits 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} May 03 21:28:59.525257 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-e120477f-a51d-475e-b51b-ff293c2663e6 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Flavor pref 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} May 03 21:28:59.525901 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-e120477f-a51d-475e-b51b-ff293c2663e6 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Image pref 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} May 03 21:28:59.527032 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-e120477f-a51d-475e-b51b-ff293c2663e6 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} May 03 21:28:59.545271 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e120477f-a51d-475e-b51b-ff293c2663e6 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:28:59.564351 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e120477f-a51d-475e-b51b-ff293c2663e6 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:28:59.564351 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e120477f-a51d-475e-b51b-ff293c2663e6 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:28:59.564351 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e120477f-a51d-475e-b51b-ff293c2663e6 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:28:59.635574 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-e120477f-a51d-475e-b51b-ff293c2663e6 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Getting quotas for project bd571e41b44a4bc6b16bf8163252f168. Resources: {'instances', 'ram', 'cores'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:28:59.650197 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-e120477f-a51d-475e-b51b-ff293c2663e6 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Getting quotas for user c2fe2da4d72e4522ac8bbb7c9a58381a and project bd571e41b44a4bc6b16bf8163252f168. Resources: {'instances', 'ram', 'cores'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:28:59.685593 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-e120477f-a51d-475e-b51b-ff293c2663e6 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Going to run 1 instances... {{(pid=97832) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} May 03 21:28:59.691625 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-e120477f-a51d-475e-b51b-ff293c2663e6 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5214328-64f1-4aa6-aa05-61f0189e0e1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=97832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} May 03 21:28:59.807658 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-e8a1b422-79c3-4da1-8608-da279c5aa2f1 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d5d87a502542b6b1215ad2f2531fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ad2a8e2573405fa636364bdf765504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:28:59.844237 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-e8a1b422-79c3-4da1-8608-da279c5aa2f1 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] 10.222.0.48 "GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d" status: 200 len: 1315 microversion: 2.1 time: 0.776792 May 03 21:28:59.844825 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 17/29] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:28:59 2022] GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d => generated 1315 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:28:59.872600 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-b082bd13-3327-4ef1-99ad-36a7531022f8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:28:59.873500 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-b082bd13-3327-4ef1-99ad-36a7531022f8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:28:59.888022 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b082bd13-3327-4ef1-99ad-36a7531022f8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:28:59.888022 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b082bd13-3327-4ef1-99ad-36a7531022f8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:28:59.888022 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b082bd13-3327-4ef1-99ad-36a7531022f8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:28:59.888022 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b082bd13-3327-4ef1-99ad-36a7531022f8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:28:59.962472 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-e120477f-a51d-475e-b51b-ff293c2663e6 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.498725 May 03 21:28:59.969570 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 13/30] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 3 21:28:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 2507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 03 21:29:00.004169 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-4605b04e-9c67-494f-90a3-7bc63a05a97a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:00.007187 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-4605b04e-9c67-494f-90a3-7bc63a05a97a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:00.110858 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-b082bd13-3327-4ef1-99ad-36a7531022f8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:00.145016 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-b082bd13-3327-4ef1-99ad-36a7531022f8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1218 microversion: 2.1 time: 0.288164 May 03 21:29:00.147178 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 18/31] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:28:59 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1218 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:00.166953 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-4605b04e-9c67-494f-90a3-7bc63a05a97a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:00.194365 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-4605b04e-9c67-494f-90a3-7bc63a05a97a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14" status: 200 len: 1241 microversion: 2.1 time: 0.220159 May 03 21:29:00.199035 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 14/32] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:28:59 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14 => generated 1241 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:00.869510 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-721d79b3-dbcc-40a7-a0c3-1f6a811d4369 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:00.871880 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-721d79b3-dbcc-40a7-a0c3-1f6a811d4369 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] [instance: 7ae08669-d95f-432b-bc27-265833de050d] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:00.902036 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-721d79b3-dbcc-40a7-a0c3-1f6a811d4369 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:00.902426 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-721d79b3-dbcc-40a7-a0c3-1f6a811d4369 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:00.910393 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-721d79b3-dbcc-40a7-a0c3-1f6a811d4369 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:00.911509 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-721d79b3-dbcc-40a7-a0c3-1f6a811d4369 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:01.184181 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-82d25029-daa8-403b-8db8-a5beb0c91ec8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:01.188028 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-82d25029-daa8-403b-8db8-a5beb0c91ec8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:01.234469 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-82d25029-daa8-403b-8db8-a5beb0c91ec8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:01.234887 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-82d25029-daa8-403b-8db8-a5beb0c91ec8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:01.239500 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-82d25029-daa8-403b-8db8-a5beb0c91ec8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:01.245248 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-82d25029-daa8-403b-8db8-a5beb0c91ec8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:01.867301 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-82d25029-daa8-403b-8db8-a5beb0c91ec8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:01.900585 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-82d25029-daa8-403b-8db8-a5beb0c91ec8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1282 microversion: 2.1 time: 0.740674 May 03 21:29:01.912530 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 15/33] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:01 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1282 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:01.938740 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-d0840a1a-08d8-460a-a89c-03a0cba683e3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:01.940524 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-d0840a1a-08d8-460a-a89c-03a0cba683e3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:02.163576 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-d0840a1a-08d8-460a-a89c-03a0cba683e3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:02.181052 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-721d79b3-dbcc-40a7-a0c3-1f6a811d4369 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d5d87a502542b6b1215ad2f2531fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ad2a8e2573405fa636364bdf765504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:02.182736 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-d0840a1a-08d8-460a-a89c-03a0cba683e3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14" status: 200 len: 1241 microversion: 2.1 time: 0.268860 May 03 21:29:02.189097 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 16/34] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:01 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14 => generated 1241 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:02.190414 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-721d79b3-dbcc-40a7-a0c3-1f6a811d4369 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] 10.222.0.48 "GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d" status: 200 len: 1315 microversion: 2.1 time: 1.332974 May 03 21:29:02.191301 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 19/35] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:00 2022] GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d => generated 1315 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:02.212681 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-728536f9-b2b8-47bb-a885-4524c3e79e0b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-930969376", "imageRef": "f5214328-64f1-4aa6-aa05-61f0189e0e1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "74dacc7e-115e-4cd0-87fd-8eaa4de43b7c"}], "security_groups": [{"name": "tempest-securitygroup--1322816725"}], "key_name": "tempest-keypair-446845386", "user_data": "}} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:29:02.487526 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-34bc9efb-b88a-4547-936b-c1069cb8f4d0 req-cdb9b5eb-c418-4f6b-848b-f00035bba4d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dffdb65a-4c55-4f89-afd3-ff88a82805d9", "tag": "703e14ee-54de-44ea-bfca-17283964e8b4"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:29:02.497891 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:29:02.497891 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:29:02.513784 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-34bc9efb-b88a-4547-936b-c1069cb8f4d0 req-cdb9b5eb-c418-4f6b-848b-f00035bba4d0 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:02.515502 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-34bc9efb-b88a-4547-936b-c1069cb8f4d0 req-cdb9b5eb-c418-4f6b-848b-f00035bba4d0 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:02.547371 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-34bc9efb-b88a-4547-936b-c1069cb8f4d0 req-cdb9b5eb-c418-4f6b-848b-f00035bba4d0 service nova] Creating event network-changed:703e14ee-54de-44ea-bfca-17283964e8b4 for instance dffdb65a-4c55-4f89-afd3-ff88a82805d9 on hv-cinder-84037 May 03 21:29:02.556193 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-34bc9efb-b88a-4547-936b-c1069cb8f4d0 req-cdb9b5eb-c418-4f6b-848b-f00035bba4d0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.362818 May 03 21:29:02.557248 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 20/36] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:29:02.787692 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.network.neutron [None req-728536f9-b2b8-47bb-a885-4524c3e79e0b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] validate_networks() for [('74dacc7e-115e-4cd0-87fd-8eaa4de43b7c', None, None, None)] {{(pid=97832) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} May 03 21:29:02.971229 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-8d7556e6-419a-4691-b226-b5a1df9a158a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:02.973328 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-8d7556e6-419a-4691-b226-b5a1df9a158a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:02.996950 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8d7556e6-419a-4691-b226-b5a1df9a158a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:02.997996 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8d7556e6-419a-4691-b226-b5a1df9a158a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:02.999136 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8d7556e6-419a-4691-b226-b5a1df9a158a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:02.999980 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8d7556e6-419a-4691-b226-b5a1df9a158a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:03.311725 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-8d7556e6-419a-4691-b226-b5a1df9a158a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:03.324715 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-8d7556e6-419a-4691-b226-b5a1df9a158a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1280 microversion: 2.1 time: 0.389281 May 03 21:29:03.336976 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 21/37] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:02 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1280 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:29:03.350563 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-57ee65d3-a335-4d4e-ae3b-30a5f99657e7 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:03.351343 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-57ee65d3-a335-4d4e-ae3b-30a5f99657e7 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:03.382626 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-57ee65d3-a335-4d4e-ae3b-30a5f99657e7 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:03.389214 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-57ee65d3-a335-4d4e-ae3b-30a5f99657e7 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:03.393509 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-57ee65d3-a335-4d4e-ae3b-30a5f99657e7 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:03.394950 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-57ee65d3-a335-4d4e-ae3b-30a5f99657e7 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:03.553493 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-57ee65d3-a335-4d4e-ae3b-30a5f99657e7 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:03.564035 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-57ee65d3-a335-4d4e-ae3b-30a5f99657e7 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14" status: 200 len: 1293 microversion: 2.1 time: 0.225403 May 03 21:29:03.565523 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 22/38] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:03 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14 => generated 1293 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:03.581349 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-1b60a562-b780-4e18-bcdb-146ad73f3635 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:03.582337 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-1b60a562-b780-4e18-bcdb-146ad73f3635 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] [instance: 7ae08669-d95f-432b-bc27-265833de050d] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:03.597500 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1b60a562-b780-4e18-bcdb-146ad73f3635 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:03.598265 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1b60a562-b780-4e18-bcdb-146ad73f3635 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:03.599182 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1b60a562-b780-4e18-bcdb-146ad73f3635 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:03.599625 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1b60a562-b780-4e18-bcdb-146ad73f3635 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:04.262510 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-1b60a562-b780-4e18-bcdb-146ad73f3635 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d5d87a502542b6b1215ad2f2531fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ad2a8e2573405fa636364bdf765504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:04.280752 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-1b60a562-b780-4e18-bcdb-146ad73f3635 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] 10.222.0.48 "GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d" status: 200 len: 1315 microversion: 2.1 time: 0.711421 May 03 21:29:04.282724 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 23/39] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:03 2022] GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d => generated 1315 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:04.317960 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-e943b3d1-f4cf-4045-92a3-68de3c7facb3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-719560209", "imageRef": "f5214328-64f1-4aa6-aa05-61f0189e0e1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a76ba353-ab28-4792-b070-a9ace23ad085"}], "security_groups": [{"name": "tempest-securitygroup--1658227604"}], "key_name": "tempest-keypair-217153273", "user_data": "}} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:29:04.552900 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-728536f9-b2b8-47bb-a885-4524c3e79e0b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Flavor limits 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} May 03 21:29:04.554101 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-728536f9-b2b8-47bb-a885-4524c3e79e0b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Image limits 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} May 03 21:29:04.554715 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-728536f9-b2b8-47bb-a885-4524c3e79e0b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Flavor pref 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} May 03 21:29:04.555310 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-728536f9-b2b8-47bb-a885-4524c3e79e0b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Image pref 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} May 03 21:29:04.555894 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-728536f9-b2b8-47bb-a885-4524c3e79e0b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} May 03 21:29:04.567186 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-728536f9-b2b8-47bb-a885-4524c3e79e0b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:04.567640 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-728536f9-b2b8-47bb-a885-4524c3e79e0b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:04.568495 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-728536f9-b2b8-47bb-a885-4524c3e79e0b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:04.569319 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-728536f9-b2b8-47bb-a885-4524c3e79e0b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:04.592998 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-728536f9-b2b8-47bb-a885-4524c3e79e0b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Getting quotas for project a2df1ca790224a009004c3c22a5ee5c5. Resources: {'instances', 'ram', 'cores'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:29:04.599217 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-728536f9-b2b8-47bb-a885-4524c3e79e0b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Getting quotas for user 649d5374c0ae4842853cd3b425d1d6d2 and project a2df1ca790224a009004c3c22a5ee5c5. Resources: {'instances', 'ram', 'cores'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:29:04.614466 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-728536f9-b2b8-47bb-a885-4524c3e79e0b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Going to run 1 instances... {{(pid=97832) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} May 03 21:29:04.617263 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-728536f9-b2b8-47bb-a885-4524c3e79e0b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5214328-64f1-4aa6-aa05-61f0189e0e1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=97832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} May 03 21:29:05.124009 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.network.neutron [None req-e943b3d1-f4cf-4045-92a3-68de3c7facb3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] validate_networks() for [('a76ba353-ab28-4792-b070-a9ace23ad085', None, None, None)] {{(pid=97831) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} May 03 21:29:05.151507 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-728536f9-b2b8-47bb-a885-4524c3e79e0b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.960933 May 03 21:29:05.154668 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 17/40] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 3 21:29:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 2965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 03 21:29:05.201464 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-15265bb0-6fe4-42cf-bbe5-ab033163bb7c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:05.204828 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-15265bb0-6fe4-42cf-bbe5-ab033163bb7c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:05.220934 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-15265bb0-6fe4-42cf-bbe5-ab033163bb7c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:05.221835 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-15265bb0-6fe4-42cf-bbe5-ab033163bb7c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:05.222949 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-15265bb0-6fe4-42cf-bbe5-ab033163bb7c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:05.223948 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-15265bb0-6fe4-42cf-bbe5-ab033163bb7c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:05.723260 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-15265bb0-6fe4-42cf-bbe5-ab033163bb7c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:05.744899 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-15265bb0-6fe4-42cf-bbe5-ab033163bb7c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1322 microversion: 2.1 time: 0.576624 May 03 21:29:05.745743 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 18/41] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:05 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1322 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:05.770575 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-f43780d5-7807-40db-83e7-69a74a112971 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:05.772120 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-f43780d5-7807-40db-83e7-69a74a112971 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:05.781942 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f43780d5-7807-40db-83e7-69a74a112971 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:05.782829 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f43780d5-7807-40db-83e7-69a74a112971 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:05.783933 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f43780d5-7807-40db-83e7-69a74a112971 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:05.784621 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f43780d5-7807-40db-83e7-69a74a112971 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:05.977398 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-f43780d5-7807-40db-83e7-69a74a112971 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:05.989904 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-f43780d5-7807-40db-83e7-69a74a112971 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14" status: 200 len: 1299 microversion: 2.1 time: 0.241778 May 03 21:29:05.991035 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 19/42] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:05 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14 => generated 1299 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:06.006083 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-ce31ec71-f802-4a46-b9e0-974faffcf09e tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:06.007031 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-ce31ec71-f802-4a46-b9e0-974faffcf09e tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:06.149117 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-ce31ec71-f802-4a46-b9e0-974faffcf09e tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:06.160733 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-ce31ec71-f802-4a46-b9e0-974faffcf09e tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1236 microversion: 2.1 time: 0.168375 May 03 21:29:06.162177 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 20/43] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:05 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1236 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:06.173848 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-3d2d29b7-d2f9-408b-ac1a-5917d654e699 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:06.174612 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-3d2d29b7-d2f9-408b-ac1a-5917d654e699 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] [instance: 7ae08669-d95f-432b-bc27-265833de050d] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:06.184102 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3d2d29b7-d2f9-408b-ac1a-5917d654e699 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:06.184857 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3d2d29b7-d2f9-408b-ac1a-5917d654e699 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:06.186888 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3d2d29b7-d2f9-408b-ac1a-5917d654e699 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:06.187531 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3d2d29b7-d2f9-408b-ac1a-5917d654e699 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:06.555294 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-3d2d29b7-d2f9-408b-ac1a-5917d654e699 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d5d87a502542b6b1215ad2f2531fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ad2a8e2573405fa636364bdf765504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:06.566840 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-3d2d29b7-d2f9-408b-ac1a-5917d654e699 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] 10.222.0.48 "GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d" status: 200 len: 1315 microversion: 2.1 time: 0.403101 May 03 21:29:06.576509 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 21/44] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:06 2022] GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d => generated 1315 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:06.730933 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-f308598a-f51a-4674-b9cc-7c69ebfb9ffa req-6b9313ae-5c20-45ce-b92e-d28ff1a0d04e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ae08669-d95f-432b-bc27-265833de050d", "name": "network-vif-plugged", "status": "completed", "tag": "99d8b720-a305-456d-805e-84e960517e14"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:29:06.772981 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:29:06.772981 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:29:06.789085 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-f308598a-f51a-4674-b9cc-7c69ebfb9ffa req-6b9313ae-5c20-45ce-b92e-d28ff1a0d04e service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:06.789710 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-f308598a-f51a-4674-b9cc-7c69ebfb9ffa req-6b9313ae-5c20-45ce-b92e-d28ff1a0d04e service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:06.828962 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-f308598a-f51a-4674-b9cc-7c69ebfb9ffa req-6b9313ae-5c20-45ce-b92e-d28ff1a0d04e service nova] Creating event network-vif-plugged:99d8b720-a305-456d-805e-84e960517e14 for instance 7ae08669-d95f-432b-bc27-265833de050d on hv-cinder-84037 May 03 21:29:06.829491 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-f308598a-f51a-4674-b9cc-7c69ebfb9ffa req-6b9313ae-5c20-45ce-b92e-d28ff1a0d04e service nova] Acquired lock "compute-rpcapi-router" {{(pid=97832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} May 03 21:29:06.836662 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cb47f031-1cf0-4a1b-91e7-aa4e9e5ed154 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:06.840520 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cb47f031-1cf0-4a1b-91e7-aa4e9e5ed154 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:06.841676 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cb47f031-1cf0-4a1b-91e7-aa4e9e5ed154 None None] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:06.842301 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cb47f031-1cf0-4a1b-91e7-aa4e9e5ed154 None None] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:06.862865 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.compute.rpcapi [None req-cb47f031-1cf0-4a1b-91e7-aa4e9e5ed154 None None] Automatically selected compute RPC version 5.12 from minimum service version 53 May 03 21:29:06.864228 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cb47f031-1cf0-4a1b-91e7-aa4e9e5ed154 None None] Releasing lock "compute-rpcapi-router" {{(pid=97832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} May 03 21:29:06.924542 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-cb47f031-1cf0-4a1b-91e7-aa4e9e5ed154 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.347621 May 03 21:29:06.924542 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 22/45] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:29:06.928730 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-f604010c-790d-44be-97cf-586f9f0a4d87 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:06.929660 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-f604010c-790d-44be-97cf-586f9f0a4d87 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:06.937949 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f604010c-790d-44be-97cf-586f9f0a4d87 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:06.938408 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f604010c-790d-44be-97cf-586f9f0a4d87 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:06.939420 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f604010c-790d-44be-97cf-586f9f0a4d87 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:06.939854 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f604010c-790d-44be-97cf-586f9f0a4d87 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:07.199827 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-f604010c-790d-44be-97cf-586f9f0a4d87 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:07.214991 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-f604010c-790d-44be-97cf-586f9f0a4d87 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1322 microversion: 2.1 time: 0.295782 May 03 21:29:07.215864 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 23/46] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:06 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1322 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:07.240710 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-c240e442-3624-4787-abee-6f453443003a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:07.241344 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-c240e442-3624-4787-abee-6f453443003a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:07.254205 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c240e442-3624-4787-abee-6f453443003a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:07.254653 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c240e442-3624-4787-abee-6f453443003a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:07.255536 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c240e442-3624-4787-abee-6f453443003a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:07.255875 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c240e442-3624-4787-abee-6f453443003a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:07.448897 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-c240e442-3624-4787-abee-6f453443003a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:07.463021 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-c240e442-3624-4787-abee-6f453443003a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14" status: 200 len: 1299 microversion: 2.1 time: 0.246215 May 03 21:29:07.465222 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 24/47] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:07 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14 => generated 1299 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:07.481443 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-7854d3d7-7446-453d-9357-270c7697689d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:07.482159 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-7854d3d7-7446-453d-9357-270c7697689d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:07.497009 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7854d3d7-7446-453d-9357-270c7697689d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:07.497566 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7854d3d7-7446-453d-9357-270c7697689d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:07.498439 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7854d3d7-7446-453d-9357-270c7697689d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:07.499927 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7854d3d7-7446-453d-9357-270c7697689d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:07.744153 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-7854d3d7-7446-453d-9357-270c7697689d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:07.760631 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-7854d3d7-7446-453d-9357-270c7697689d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1240 microversion: 2.1 time: 0.293657 May 03 21:29:07.761190 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 25/48] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:07 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1240 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:07.781339 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-db50b6e2-8c8c-4c3f-be64-482da69deffa tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:07.784497 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-db50b6e2-8c8c-4c3f-be64-482da69deffa tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] [instance: 7ae08669-d95f-432b-bc27-265833de050d] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:07.805919 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-db50b6e2-8c8c-4c3f-be64-482da69deffa tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:07.806385 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-db50b6e2-8c8c-4c3f-be64-482da69deffa tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:07.807464 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-db50b6e2-8c8c-4c3f-be64-482da69deffa tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:07.807909 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-db50b6e2-8c8c-4c3f-be64-482da69deffa tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:08.312668 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-e943b3d1-f4cf-4045-92a3-68de3c7facb3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Flavor limits 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} May 03 21:29:08.312668 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-e943b3d1-f4cf-4045-92a3-68de3c7facb3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Image limits 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} May 03 21:29:08.313412 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-e943b3d1-f4cf-4045-92a3-68de3c7facb3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Flavor pref 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} May 03 21:29:08.313854 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-e943b3d1-f4cf-4045-92a3-68de3c7facb3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Image pref 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} May 03 21:29:08.314765 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-e943b3d1-f4cf-4045-92a3-68de3c7facb3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} May 03 21:29:08.339688 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e943b3d1-f4cf-4045-92a3-68de3c7facb3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:08.340222 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e943b3d1-f4cf-4045-92a3-68de3c7facb3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:08.341180 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e943b3d1-f4cf-4045-92a3-68de3c7facb3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:08.341706 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e943b3d1-f4cf-4045-92a3-68de3c7facb3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:08.398918 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-e943b3d1-f4cf-4045-92a3-68de3c7facb3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Getting quotas for project 4cf52ffb4a864a689f5d0242ddc4cc4f. Resources: {'instances', 'ram', 'cores'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:29:08.413957 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-e943b3d1-f4cf-4045-92a3-68de3c7facb3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Getting quotas for user 2f7bb76fefa8402db231ed466d351631 and project 4cf52ffb4a864a689f5d0242ddc4cc4f. Resources: {'instances', 'ram', 'cores'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:29:08.484528 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-e943b3d1-f4cf-4045-92a3-68de3c7facb3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Going to run 1 instances... {{(pid=97831) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} May 03 21:29:08.501977 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-e943b3d1-f4cf-4045-92a3-68de3c7facb3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5214328-64f1-4aa6-aa05-61f0189e0e1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=97831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} May 03 21:29:08.742791 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-db50b6e2-8c8c-4c3f-be64-482da69deffa tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d5d87a502542b6b1215ad2f2531fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ad2a8e2573405fa636364bdf765504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:08.753765 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-e943b3d1-f4cf-4045-92a3-68de3c7facb3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.467484 May 03 21:29:08.754433 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-db50b6e2-8c8c-4c3f-be64-482da69deffa tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] 10.222.0.48 "GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d" status: 200 len: 1315 microversion: 2.1 time: 0.992161 May 03 21:29:08.758077 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 26/49] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:07 2022] GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d => generated 1315 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:08.765976 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 24/50] 10.222.0.48 () {62 vars in 1187 bytes} [Tue May 3 21:29:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 4482 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 03 21:29:08.811399 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-9e51d5f4-1ab4-4c26-a045-89f21d1f28f0 req-c5c2905b-0094-48ba-9f5f-42407e27a2ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11444b4c-e752-4766-9e89-f57974330390", "tag": "85e667f2-845e-4e89-b387-1500b1f84677"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:29:08.816377 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:29:08.816377 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:29:08.840471 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-ea5aa9eb-219b-4d2e-b3cc-2702137872e7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:08.841419 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-ea5aa9eb-219b-4d2e-b3cc-2702137872e7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:08.874167 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-9e51d5f4-1ab4-4c26-a045-89f21d1f28f0 req-c5c2905b-0094-48ba-9f5f-42407e27a2ab service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:08.874167 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-9e51d5f4-1ab4-4c26-a045-89f21d1f28f0 req-c5c2905b-0094-48ba-9f5f-42407e27a2ab service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:08.878431 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ea5aa9eb-219b-4d2e-b3cc-2702137872e7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:08.879582 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ea5aa9eb-219b-4d2e-b3cc-2702137872e7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:08.881543 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ea5aa9eb-219b-4d2e-b3cc-2702137872e7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:08.884365 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ea5aa9eb-219b-4d2e-b3cc-2702137872e7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:08.944096 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-9e51d5f4-1ab4-4c26-a045-89f21d1f28f0 req-c5c2905b-0094-48ba-9f5f-42407e27a2ab service nova] Creating event network-changed:85e667f2-845e-4e89-b387-1500b1f84677 for instance 11444b4c-e752-4766-9e89-f57974330390 on hv-cinder-84037 May 03 21:29:08.971098 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-9e51d5f4-1ab4-4c26-a045-89f21d1f28f0 req-c5c2905b-0094-48ba-9f5f-42407e27a2ab service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.210882 May 03 21:29:08.976911 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 27/51] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:29:09.074901 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-dd37f9cb-e6d8-479a-9c27-ec1e71275518 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:09.075845 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-dd37f9cb-e6d8-479a-9c27-ec1e71275518 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:09.128743 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-dd37f9cb-e6d8-479a-9c27-ec1e71275518 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:09.128743 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-dd37f9cb-e6d8-479a-9c27-ec1e71275518 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:09.128743 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-dd37f9cb-e6d8-479a-9c27-ec1e71275518 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:09.128743 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-dd37f9cb-e6d8-479a-9c27-ec1e71275518 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:10.010887 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-dd37f9cb-e6d8-479a-9c27-ec1e71275518 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:10.040465 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-dd37f9cb-e6d8-479a-9c27-ec1e71275518 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14" status: 200 len: 1367 microversion: 2.1 time: 1.059884 May 03 21:29:10.041012 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 28/52] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:08 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14 => generated 1367 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:10.088023 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-c1a1b9fc-c6ce-4668-8dd9-ba7c00f065b7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:10.088699 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-c1a1b9fc-c6ce-4668-8dd9-ba7c00f065b7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:10.302813 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-c1a1b9fc-c6ce-4668-8dd9-ba7c00f065b7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:10.324601 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-c1a1b9fc-c6ce-4668-8dd9-ba7c00f065b7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:10.333278 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-c1a1b9fc-c6ce-4668-8dd9-ba7c00f065b7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:10.334811 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-c1a1b9fc-c6ce-4668-8dd9-ba7c00f065b7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1280 microversion: 2.20 time: 0.292801 May 03 21:29:10.335965 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 29/53] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:29:10 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1280 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:29:10.349237 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-470ed319-1536-44c8-86fe-4687ee02c1df tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:10.350399 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-470ed319-1536-44c8-86fe-4687ee02c1df tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:10.364808 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-470ed319-1536-44c8-86fe-4687ee02c1df tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:10.366134 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-470ed319-1536-44c8-86fe-4687ee02c1df tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:10.367425 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-470ed319-1536-44c8-86fe-4687ee02c1df tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:10.368082 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-470ed319-1536-44c8-86fe-4687ee02c1df tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:10.566070 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-470ed319-1536-44c8-86fe-4687ee02c1df tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:10.581291 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-470ed319-1536-44c8-86fe-4687ee02c1df tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1294 microversion: 2.1 time: 0.243798 May 03 21:29:10.583644 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 30/54] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:10 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1294 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:10.596273 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-4401f632-6bc1-4dd9-9673-181be65e0015 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:10.597432 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-4401f632-6bc1-4dd9-9673-181be65e0015 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] [instance: 7ae08669-d95f-432b-bc27-265833de050d] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:10.613185 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4401f632-6bc1-4dd9-9673-181be65e0015 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:10.616917 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4401f632-6bc1-4dd9-9673-181be65e0015 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:10.618222 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4401f632-6bc1-4dd9-9673-181be65e0015 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:10.618690 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4401f632-6bc1-4dd9-9673-181be65e0015 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:10.846177 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-ea5aa9eb-219b-4d2e-b3cc-2702137872e7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:10.856085 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-ea5aa9eb-219b-4d2e-b3cc-2702137872e7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1322 microversion: 2.1 time: 2.088922 May 03 21:29:10.867049 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 25/55] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:08 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1322 bytes in 2100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:10.879581 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-03b76bf7-df44-46e3-b2c7-87cb9d52c691 req-271bc8d1-13a1-4881-8999-d0850a3db380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dffdb65a-4c55-4f89-afd3-ff88a82805d9", "name": "network-vif-plugged", "status": "completed", "tag": "703e14ee-54de-44ea-bfca-17283964e8b4"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:29:10.887570 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:29:10.887570 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:29:10.898268 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-03b76bf7-df44-46e3-b2c7-87cb9d52c691 req-271bc8d1-13a1-4881-8999-d0850a3db380 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:10.898980 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-03b76bf7-df44-46e3-b2c7-87cb9d52c691 req-271bc8d1-13a1-4881-8999-d0850a3db380 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:10.917729 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-03b76bf7-df44-46e3-b2c7-87cb9d52c691 req-271bc8d1-13a1-4881-8999-d0850a3db380 service nova] Creating event network-vif-plugged:703e14ee-54de-44ea-bfca-17283964e8b4 for instance dffdb65a-4c55-4f89-afd3-ff88a82805d9 on hv-cinder-84037 May 03 21:29:10.924273 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-03b76bf7-df44-46e3-b2c7-87cb9d52c691 req-271bc8d1-13a1-4881-8999-d0850a3db380 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055641 May 03 21:29:10.925124 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 26/56] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:29:10.979410 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-4401f632-6bc1-4dd9-9673-181be65e0015 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d5d87a502542b6b1215ad2f2531fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ad2a8e2573405fa636364bdf765504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:11.001867 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-4401f632-6bc1-4dd9-9673-181be65e0015 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] 10.222.0.48 "GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d" status: 200 len: 1315 microversion: 2.1 time: 0.416942 May 03 21:29:11.003455 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 31/57] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:10 2022] GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:11.089474 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-f89dfb54-f6d2-45fe-a319-6bceba485649 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:11.090397 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-f89dfb54-f6d2-45fe-a319-6bceba485649 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:11.102378 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f89dfb54-f6d2-45fe-a319-6bceba485649 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:11.105085 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f89dfb54-f6d2-45fe-a319-6bceba485649 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:11.107619 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f89dfb54-f6d2-45fe-a319-6bceba485649 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:11.112339 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f89dfb54-f6d2-45fe-a319-6bceba485649 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:11.395441 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-a5004b4f-71d6-4cf3-b70b-2a9166709a85 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:11.396064 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-a5004b4f-71d6-4cf3-b70b-2a9166709a85 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:11.404021 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a5004b4f-71d6-4cf3-b70b-2a9166709a85 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:11.404519 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a5004b4f-71d6-4cf3-b70b-2a9166709a85 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:11.405489 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a5004b4f-71d6-4cf3-b70b-2a9166709a85 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:11.443935 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a5004b4f-71d6-4cf3-b70b-2a9166709a85 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:11.696966 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-a5004b4f-71d6-4cf3-b70b-2a9166709a85 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:11.724153 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-a5004b4f-71d6-4cf3-b70b-2a9166709a85 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:11.739822 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-a5004b4f-71d6-4cf3-b70b-2a9166709a85 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:11.753284 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-a5004b4f-71d6-4cf3-b70b-2a9166709a85 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1284 microversion: 2.20 time: 0.394654 May 03 21:29:11.753284 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 32/58] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:29:11 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1284 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:29:11.776364 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-097fa6dc-2372-43de-a954-4e9e245c6956 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:11.788148 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-097fa6dc-2372-43de-a954-4e9e245c6956 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:11.799566 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-097fa6dc-2372-43de-a954-4e9e245c6956 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:11.800278 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-097fa6dc-2372-43de-a954-4e9e245c6956 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:11.801524 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-097fa6dc-2372-43de-a954-4e9e245c6956 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:11.802189 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-097fa6dc-2372-43de-a954-4e9e245c6956 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:12.045356 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-097fa6dc-2372-43de-a954-4e9e245c6956 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:12.054238 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-097fa6dc-2372-43de-a954-4e9e245c6956 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1294 microversion: 2.1 time: 0.292688 May 03 21:29:12.054811 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 33/59] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:11 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1294 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:12.072994 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-e25ae24a-7494-4891-aeb8-c4c5da2be40e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:12.073253 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-e25ae24a-7494-4891-aeb8-c4c5da2be40e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:12.097533 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e25ae24a-7494-4891-aeb8-c4c5da2be40e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:12.097932 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e25ae24a-7494-4891-aeb8-c4c5da2be40e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:12.098718 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e25ae24a-7494-4891-aeb8-c4c5da2be40e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:12.099146 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e25ae24a-7494-4891-aeb8-c4c5da2be40e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:12.481798 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-e25ae24a-7494-4891-aeb8-c4c5da2be40e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:12.493654 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-e25ae24a-7494-4891-aeb8-c4c5da2be40e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1322 microversion: 2.1 time: 0.437637 May 03 21:29:12.495005 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 34/60] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:12 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1322 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:12.509045 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-ed053d0c-7597-41cb-8a69-50b3a477de7e tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:12.510025 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-ed053d0c-7597-41cb-8a69-50b3a477de7e tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] [instance: 7ae08669-d95f-432b-bc27-265833de050d] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:12.526374 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ed053d0c-7597-41cb-8a69-50b3a477de7e tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:12.526840 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ed053d0c-7597-41cb-8a69-50b3a477de7e tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:12.528151 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ed053d0c-7597-41cb-8a69-50b3a477de7e tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:12.528151 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ed053d0c-7597-41cb-8a69-50b3a477de7e tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:12.887106 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-ed053d0c-7597-41cb-8a69-50b3a477de7e tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d5d87a502542b6b1215ad2f2531fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ad2a8e2573405fa636364bdf765504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:12.898448 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-ed053d0c-7597-41cb-8a69-50b3a477de7e tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] 10.222.0.48 "GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d" status: 200 len: 1315 microversion: 2.1 time: 0.402078 May 03 21:29:12.899285 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 35/61] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:12 2022] GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d => generated 1315 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:12.911204 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-9592884b-4e86-4b94-b469-26045b5a0e3c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:12.912031 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-9592884b-4e86-4b94-b469-26045b5a0e3c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:12.919730 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9592884b-4e86-4b94-b469-26045b5a0e3c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:12.920417 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9592884b-4e86-4b94-b469-26045b5a0e3c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:12.921615 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9592884b-4e86-4b94-b469-26045b5a0e3c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:12.922194 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9592884b-4e86-4b94-b469-26045b5a0e3c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:12.956768 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-f89dfb54-f6d2-45fe-a319-6bceba485649 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:12.977078 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-f89dfb54-f6d2-45fe-a319-6bceba485649 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14" status: 200 len: 1367 microversion: 2.1 time: 1.921829 May 03 21:29:12.983397 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 27/62] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:11 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14 => generated 1367 bytes in 1930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:13.061501 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-9592884b-4e86-4b94-b469-26045b5a0e3c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:13.087208 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-f400d714-9d77-452b-ad48-16ef673c30b6 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:13.087831 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-f400d714-9d77-452b-ad48-16ef673c30b6 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:13.091050 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-9592884b-4e86-4b94-b469-26045b5a0e3c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:13.100868 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-9592884b-4e86-4b94-b469-26045b5a0e3c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:13.101950 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-9592884b-4e86-4b94-b469-26045b5a0e3c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1332 microversion: 2.20 time: 0.201594 May 03 21:29:13.105742 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f400d714-9d77-452b-ad48-16ef673c30b6 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:13.106942 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f400d714-9d77-452b-ad48-16ef673c30b6 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:13.107195 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 36/63] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:29:12 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1332 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:29:13.108390 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f400d714-9d77-452b-ad48-16ef673c30b6 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:13.109239 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f400d714-9d77-452b-ad48-16ef673c30b6 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:13.332188 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-6376c705-41dc-498f-9a39-ad28ebaeae80 req-1b154e25-4686-4221-a78e-15c36116301b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12a46337-1502-4a61-8c0d-8b5dd98d5a14", "tag": "5c8533bd-9029-4055-8bb5-b5628053505e"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:29:13.335672 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:29:13.335672 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:29:13.348657 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-6376c705-41dc-498f-9a39-ad28ebaeae80 req-1b154e25-4686-4221-a78e-15c36116301b service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:13.349410 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-6376c705-41dc-498f-9a39-ad28ebaeae80 req-1b154e25-4686-4221-a78e-15c36116301b service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:13.374791 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-6376c705-41dc-498f-9a39-ad28ebaeae80 req-1b154e25-4686-4221-a78e-15c36116301b service nova] Creating event network-changed:5c8533bd-9029-4055-8bb5-b5628053505e for instance 12a46337-1502-4a61-8c0d-8b5dd98d5a14 on hv-cinder-84037 May 03 21:29:13.382158 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-6376c705-41dc-498f-9a39-ad28ebaeae80 req-1b154e25-4686-4221-a78e-15c36116301b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079382 May 03 21:29:13.389086 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 37/64] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:29:13.555682 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-29791b68-e100-45f5-81a7-277e59728ef4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:13.557379 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-29791b68-e100-45f5-81a7-277e59728ef4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:13.597157 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-29791b68-e100-45f5-81a7-277e59728ef4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:13.597966 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-29791b68-e100-45f5-81a7-277e59728ef4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:13.598997 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-29791b68-e100-45f5-81a7-277e59728ef4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:13.608465 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-29791b68-e100-45f5-81a7-277e59728ef4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:13.896175 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-29791b68-e100-45f5-81a7-277e59728ef4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:13.905195 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-29791b68-e100-45f5-81a7-277e59728ef4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1322 microversion: 2.1 time: 0.391367 May 03 21:29:13.915995 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 38/65] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:13 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1322 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:13.929864 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-2dcd1d8a-0693-4011-8b69-baf14a38bb5e tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:13.930895 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-2dcd1d8a-0693-4011-8b69-baf14a38bb5e tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] [instance: 7ae08669-d95f-432b-bc27-265833de050d] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:13.938991 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2dcd1d8a-0693-4011-8b69-baf14a38bb5e tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:13.939668 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2dcd1d8a-0693-4011-8b69-baf14a38bb5e tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:13.940464 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2dcd1d8a-0693-4011-8b69-baf14a38bb5e tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:13.941044 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2dcd1d8a-0693-4011-8b69-baf14a38bb5e tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:14.260717 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-2dcd1d8a-0693-4011-8b69-baf14a38bb5e tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d5d87a502542b6b1215ad2f2531fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ad2a8e2573405fa636364bdf765504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:14.273005 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-2dcd1d8a-0693-4011-8b69-baf14a38bb5e tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] 10.222.0.48 "GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d" status: 200 len: 1503 microversion: 2.1 time: 0.355360 May 03 21:29:14.273884 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 39/66] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:13 2022] GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d => generated 1503 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:14.285047 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-359b32e6-7efe-4446-9bc5-0c59b5bb55ba tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:14.285668 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-359b32e6-7efe-4446-9bc5-0c59b5bb55ba tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:14.309546 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-359b32e6-7efe-4446-9bc5-0c59b5bb55ba tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:14.310002 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-359b32e6-7efe-4446-9bc5-0c59b5bb55ba tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:14.311949 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-359b32e6-7efe-4446-9bc5-0c59b5bb55ba tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:14.312364 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-359b32e6-7efe-4446-9bc5-0c59b5bb55ba tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:14.325189 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-f400d714-9d77-452b-ad48-16ef673c30b6 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:14.343686 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-f400d714-9d77-452b-ad48-16ef673c30b6 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1362 microversion: 2.1 time: 1.264743 May 03 21:29:14.345927 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 28/67] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:13 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1362 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:29:14.386646 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-ccf718a9-20a3-4a72-a046-90196adde17d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:14.387446 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-ccf718a9-20a3-4a72-a046-90196adde17d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:14.398006 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ccf718a9-20a3-4a72-a046-90196adde17d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:14.399046 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ccf718a9-20a3-4a72-a046-90196adde17d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:14.400147 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ccf718a9-20a3-4a72-a046-90196adde17d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:14.401858 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ccf718a9-20a3-4a72-a046-90196adde17d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:14.596303 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-ccf718a9-20a3-4a72-a046-90196adde17d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:14.622182 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-ccf718a9-20a3-4a72-a046-90196adde17d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:14.629780 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-ccf718a9-20a3-4a72-a046-90196adde17d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:14.631523 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-ccf718a9-20a3-4a72-a046-90196adde17d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1350 microversion: 2.20 time: 0.284246 May 03 21:29:14.632140 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 29/68] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:29:14 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1350 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:29:14.671289 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-359b32e6-7efe-4446-9bc5-0c59b5bb55ba tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:14.683402 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-359b32e6-7efe-4446-9bc5-0c59b5bb55ba tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14" status: 200 len: 1367 microversion: 2.1 time: 0.408396 May 03 21:29:14.683966 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 40/69] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:14 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14 => generated 1367 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:14.929248 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-4fb1ccab-44f2-4da5-8993-4cec6c387d85 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:14.929843 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-4fb1ccab-44f2-4da5-8993-4cec6c387d85 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:14.937214 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4fb1ccab-44f2-4da5-8993-4cec6c387d85 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:14.937662 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4fb1ccab-44f2-4da5-8993-4cec6c387d85 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:14.938437 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4fb1ccab-44f2-4da5-8993-4cec6c387d85 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:14.938869 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4fb1ccab-44f2-4da5-8993-4cec6c387d85 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:15.370126 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-4d0e06d4-d62e-4fe4-b697-b65b24d5b67f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:15.370767 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-4d0e06d4-d62e-4fe4-b697-b65b24d5b67f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:15.378284 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4d0e06d4-d62e-4fe4-b697-b65b24d5b67f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:15.378730 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4d0e06d4-d62e-4fe4-b697-b65b24d5b67f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:15.379677 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4d0e06d4-d62e-4fe4-b697-b65b24d5b67f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:15.380113 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4d0e06d4-d62e-4fe4-b697-b65b24d5b67f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:15.614999 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-4fb1ccab-44f2-4da5-8993-4cec6c387d85 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:15.630904 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-4fb1ccab-44f2-4da5-8993-4cec6c387d85 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1322 microversion: 2.1 time: 0.711503 May 03 21:29:15.633439 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 30/70] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:14 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1322 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:15.708950 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-6a264587-4df8-490a-8c06-d8a88ac5cc09 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:15.708950 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-6a264587-4df8-490a-8c06-d8a88ac5cc09 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:15.708950 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6a264587-4df8-490a-8c06-d8a88ac5cc09 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:15.708950 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6a264587-4df8-490a-8c06-d8a88ac5cc09 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:15.710511 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6a264587-4df8-490a-8c06-d8a88ac5cc09 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:15.710511 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6a264587-4df8-490a-8c06-d8a88ac5cc09 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:15.782655 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-4d0e06d4-d62e-4fe4-b697-b65b24d5b67f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:15.790793 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-4d0e06d4-d62e-4fe4-b697-b65b24d5b67f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1362 microversion: 2.1 time: 0.431302 May 03 21:29:15.791642 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 41/71] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:15 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1362 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:15.802890 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-6fa61f43-fcf4-45fb-99e2-5f425b12319b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:15.803751 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-6fa61f43-fcf4-45fb-99e2-5f425b12319b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:15.812715 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6fa61f43-fcf4-45fb-99e2-5f425b12319b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:15.813397 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6fa61f43-fcf4-45fb-99e2-5f425b12319b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:15.829086 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6fa61f43-fcf4-45fb-99e2-5f425b12319b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:15.829086 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6fa61f43-fcf4-45fb-99e2-5f425b12319b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:15.903331 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-6a264587-4df8-490a-8c06-d8a88ac5cc09 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:15.922595 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-6a264587-4df8-490a-8c06-d8a88ac5cc09 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:15.934335 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-6a264587-4df8-490a-8c06-d8a88ac5cc09 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:15.948888 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-6a264587-4df8-490a-8c06-d8a88ac5cc09 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1338 microversion: 2.20 time: 0.288936 May 03 21:29:15.950230 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 31/72] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:29:15 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1338 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:29:16.172809 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-6fa61f43-fcf4-45fb-99e2-5f425b12319b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:16.202492 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-6fa61f43-fcf4-45fb-99e2-5f425b12319b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14" status: 200 len: 1367 microversion: 2.1 time: 0.400202 May 03 21:29:16.202492 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 42/73] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:15 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14 => generated 1367 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:16.370353 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-d233c108-84df-4184-88bc-7b7e76215ad3 req-e49abf00-d612-493a-bb93-1450e3d250e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11444b4c-e752-4766-9e89-f57974330390", "name": "network-vif-plugged", "status": "completed", "tag": "85e667f2-845e-4e89-b387-1500b1f84677"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:29:16.377742 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:29:16.377742 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:29:16.398347 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-d233c108-84df-4184-88bc-7b7e76215ad3 req-e49abf00-d612-493a-bb93-1450e3d250e4 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:16.398794 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-d233c108-84df-4184-88bc-7b7e76215ad3 req-e49abf00-d612-493a-bb93-1450e3d250e4 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:16.439450 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-d233c108-84df-4184-88bc-7b7e76215ad3 req-e49abf00-d612-493a-bb93-1450e3d250e4 service nova] Creating event network-vif-plugged:85e667f2-845e-4e89-b387-1500b1f84677 for instance 11444b4c-e752-4766-9e89-f57974330390 on hv-cinder-84037 May 03 21:29:16.445187 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-d233c108-84df-4184-88bc-7b7e76215ad3 req-e49abf00-d612-493a-bb93-1450e3d250e4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084193 May 03 21:29:16.445998 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 32/74] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:29:16.643719 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-21cdda41-fe42-4788-acec-198933409a31 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8efbd6c2-7d3f-44b0-a1f8-41b8ca731d3e"}} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:29:16.644890 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-21cdda41-fe42-4788-acec-198933409a31 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] [instance: 7ae08669-d95f-432b-bc27-265833de050d] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:16.652027 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-21cdda41-fe42-4788-acec-198933409a31 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:16.652508 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-21cdda41-fe42-4788-acec-198933409a31 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:16.653289 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-21cdda41-fe42-4788-acec-198933409a31 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:16.653722 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-21cdda41-fe42-4788-acec-198933409a31 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:16.737454 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-dfa41e69-f5a3-4afb-8556-a56eec1f8271 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:16.738720 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-dfa41e69-f5a3-4afb-8556-a56eec1f8271 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:16.762111 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-dfa41e69-f5a3-4afb-8556-a56eec1f8271 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:16.765610 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-dfa41e69-f5a3-4afb-8556-a56eec1f8271 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:16.767032 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-dfa41e69-f5a3-4afb-8556-a56eec1f8271 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:16.767695 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-dfa41e69-f5a3-4afb-8556-a56eec1f8271 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:17.558035 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-dfa41e69-f5a3-4afb-8556-a56eec1f8271 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:17.567657 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-dfa41e69-f5a3-4afb-8556-a56eec1f8271 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1322 microversion: 2.1 time: 0.843808 May 03 21:29:17.568206 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 33/75] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:16 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1322 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:17.579285 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-85e25f02-491c-453e-b7b4-d79be4d7c6ac tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:17.580061 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-85e25f02-491c-453e-b7b4-d79be4d7c6ac tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:17.587401 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-85e25f02-491c-453e-b7b4-d79be4d7c6ac tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:17.587849 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-85e25f02-491c-453e-b7b4-d79be4d7c6ac tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:17.590139 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-85e25f02-491c-453e-b7b4-d79be4d7c6ac tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:17.590139 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-85e25f02-491c-453e-b7b4-d79be4d7c6ac tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:18.158844 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-85e25f02-491c-453e-b7b4-d79be4d7c6ac tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:18.170726 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-85e25f02-491c-453e-b7b4-d79be4d7c6ac tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1362 microversion: 2.1 time: 0.601266 May 03 21:29:18.172041 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 34/76] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:17 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1362 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:18.183636 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-13ba84df-5e66-4d02-bc47-3e3e200224f9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:18.184624 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-13ba84df-5e66-4d02-bc47-3e3e200224f9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:18.196796 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-13ba84df-5e66-4d02-bc47-3e3e200224f9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:18.197509 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-13ba84df-5e66-4d02-bc47-3e3e200224f9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:18.198501 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-13ba84df-5e66-4d02-bc47-3e3e200224f9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:18.199855 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-13ba84df-5e66-4d02-bc47-3e3e200224f9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:18.326984 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-21cdda41-fe42-4788-acec-198933409a31 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] 10.222.0.48 "POST /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.692602 May 03 21:29:18.328409 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 43/77] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 3 21:29:16 2022] POST /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d/os-volume_attachments => generated 194 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:29:18.339103 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-53abcb52-3840-43d0-92ae-fb5f247b91c5 req-1eb7a443-ecf9-4730-9246-0b514f68f944 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "274fd6f3-1f2e-4da8-8c5f-fa173514fc2a", "tag": "46d7aa18-8157-45ea-b292-6af9e591723f"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:29:18.345551 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:29:18.345551 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:29:18.354899 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-53abcb52-3840-43d0-92ae-fb5f247b91c5 req-1eb7a443-ecf9-4730-9246-0b514f68f944 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:18.355424 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-53abcb52-3840-43d0-92ae-fb5f247b91c5 req-1eb7a443-ecf9-4730-9246-0b514f68f944 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:18.393638 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-53abcb52-3840-43d0-92ae-fb5f247b91c5 req-1eb7a443-ecf9-4730-9246-0b514f68f944 service nova] Creating event network-changed:46d7aa18-8157-45ea-b292-6af9e591723f for instance 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a on hv-cinder-84037 May 03 21:29:18.398628 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-53abcb52-3840-43d0-92ae-fb5f247b91c5 req-1eb7a443-ecf9-4730-9246-0b514f68f944 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068635 May 03 21:29:18.399258 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 44/78] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:29:18.419240 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-79f59ee8-51e2-44fa-9359-e1f937c124a6 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:18.423311 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-79f59ee8-51e2-44fa-9359-e1f937c124a6 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:18.430385 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-79f59ee8-51e2-44fa-9359-e1f937c124a6 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:18.433900 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-79f59ee8-51e2-44fa-9359-e1f937c124a6 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:18.433900 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-79f59ee8-51e2-44fa-9359-e1f937c124a6 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:18.433900 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-79f59ee8-51e2-44fa-9359-e1f937c124a6 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:18.770687 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-79f59ee8-51e2-44fa-9359-e1f937c124a6 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:18.783928 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-79f59ee8-51e2-44fa-9359-e1f937c124a6 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14" status: 200 len: 1367 microversion: 2.1 time: 0.383154 May 03 21:29:18.789443 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 45/79] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:18 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14 => generated 1367 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:18.797363 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-154fec3f-07ec-4ef9-9a5c-93aa5d38b347 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:18.798170 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-154fec3f-07ec-4ef9-9a5c-93aa5d38b347 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:18.806295 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-154fec3f-07ec-4ef9-9a5c-93aa5d38b347 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:18.806902 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-154fec3f-07ec-4ef9-9a5c-93aa5d38b347 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:18.807690 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-154fec3f-07ec-4ef9-9a5c-93aa5d38b347 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:18.808127 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-154fec3f-07ec-4ef9-9a5c-93aa5d38b347 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:19.051861 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-154fec3f-07ec-4ef9-9a5c-93aa5d38b347 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:19.060104 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-154fec3f-07ec-4ef9-9a5c-93aa5d38b347 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1322 microversion: 2.1 time: 0.273790 May 03 21:29:19.061263 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 46/80] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:18 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:19.194557 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-b1da8049-cb1f-4038-a52a-a53811013e67 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:19.195410 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-b1da8049-cb1f-4038-a52a-a53811013e67 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:19.205193 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b1da8049-cb1f-4038-a52a-a53811013e67 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:19.206172 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b1da8049-cb1f-4038-a52a-a53811013e67 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:19.207142 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b1da8049-cb1f-4038-a52a-a53811013e67 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:19.208538 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b1da8049-cb1f-4038-a52a-a53811013e67 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:19.284050 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-13ba84df-5e66-4d02-bc47-3e3e200224f9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:19.310030 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-13ba84df-5e66-4d02-bc47-3e3e200224f9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:19.317851 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-13ba84df-5e66-4d02-bc47-3e3e200224f9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:19.318370 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-13ba84df-5e66-4d02-bc47-3e3e200224f9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1406 microversion: 2.20 time: 1.144520 May 03 21:29:19.319001 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 35/81] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:29:18 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1406 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:29:19.510128 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-b1da8049-cb1f-4038-a52a-a53811013e67 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:19.519298 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-b1da8049-cb1f-4038-a52a-a53811013e67 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1362 microversion: 2.1 time: 0.334190 May 03 21:29:19.520054 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 47/82] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:19 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1362 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:19.810713 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-9f584531-2080-4615-ab81-38489acba37e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:19.811656 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-9f584531-2080-4615-ab81-38489acba37e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:19.821307 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9f584531-2080-4615-ab81-38489acba37e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:19.827829 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9f584531-2080-4615-ab81-38489acba37e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:19.827829 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9f584531-2080-4615-ab81-38489acba37e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:19.827829 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9f584531-2080-4615-ab81-38489acba37e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:20.043638 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-9f584531-2080-4615-ab81-38489acba37e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:20.052617 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-9f584531-2080-4615-ab81-38489acba37e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14" status: 200 len: 1367 microversion: 2.1 time: 0.251042 May 03 21:29:20.053157 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 36/83] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:19 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14 => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:20.104775 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-5bbd2e50-edf8-4fc5-a733-a7353545dc81 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:20.105730 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-5bbd2e50-edf8-4fc5-a733-a7353545dc81 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:20.125571 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5bbd2e50-edf8-4fc5-a733-a7353545dc81 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:20.125571 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5bbd2e50-edf8-4fc5-a733-a7353545dc81 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:20.125571 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5bbd2e50-edf8-4fc5-a733-a7353545dc81 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:20.125571 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5bbd2e50-edf8-4fc5-a733-a7353545dc81 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:20.343019 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-7f7b325b-556c-40c6-af65-c05877dc8c6b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:20.344759 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-7f7b325b-556c-40c6-af65-c05877dc8c6b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:20.351222 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7f7b325b-556c-40c6-af65-c05877dc8c6b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:20.351729 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7f7b325b-556c-40c6-af65-c05877dc8c6b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:20.352533 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7f7b325b-556c-40c6-af65-c05877dc8c6b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:20.352963 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7f7b325b-556c-40c6-af65-c05877dc8c6b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:20.355097 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-5bbd2e50-edf8-4fc5-a733-a7353545dc81 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:20.364056 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-5bbd2e50-edf8-4fc5-a733-a7353545dc81 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1322 microversion: 2.1 time: 0.289668 May 03 21:29:20.364777 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 48/84] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:20 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1322 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:20.521095 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-e73e9b1e-08cc-4c25-9bb5-5bdd93c8ed0f req-2c6f26d7-5761-4ff2-92e9-3f208ef1add9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77f6a8a2-4366-486d-a002-05587e0f46b5", "tag": "be428a12-3d87-4da1-a665-e7b79df6af66"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:29:20.527486 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:29:20.527486 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:29:20.538715 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-e73e9b1e-08cc-4c25-9bb5-5bdd93c8ed0f req-2c6f26d7-5761-4ff2-92e9-3f208ef1add9 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:20.539356 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-e73e9b1e-08cc-4c25-9bb5-5bdd93c8ed0f req-2c6f26d7-5761-4ff2-92e9-3f208ef1add9 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:20.556231 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-e73e9b1e-08cc-4c25-9bb5-5bdd93c8ed0f req-2c6f26d7-5761-4ff2-92e9-3f208ef1add9 service nova] Creating event network-changed:be428a12-3d87-4da1-a665-e7b79df6af66 for instance 77f6a8a2-4366-486d-a002-05587e0f46b5 on hv-cinder-84037 May 03 21:29:20.561860 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-e73e9b1e-08cc-4c25-9bb5-5bdd93c8ed0f req-2c6f26d7-5761-4ff2-92e9-3f208ef1add9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050964 May 03 21:29:20.562458 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 49/85] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:29:20.573080 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-0b871971-8f06-4662-8d3e-9cb1fbf3af8f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:20.573783 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-0b871971-8f06-4662-8d3e-9cb1fbf3af8f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:20.582151 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0b871971-8f06-4662-8d3e-9cb1fbf3af8f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:20.582581 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0b871971-8f06-4662-8d3e-9cb1fbf3af8f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:20.583365 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0b871971-8f06-4662-8d3e-9cb1fbf3af8f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:20.583804 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0b871971-8f06-4662-8d3e-9cb1fbf3af8f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:20.595781 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-7f7b325b-556c-40c6-af65-c05877dc8c6b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:20.609654 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-7f7b325b-556c-40c6-af65-c05877dc8c6b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:20.616089 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-7f7b325b-556c-40c6-af65-c05877dc8c6b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:20.617189 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-7f7b325b-556c-40c6-af65-c05877dc8c6b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1406 microversion: 2.20 time: 0.284671 May 03 21:29:20.617710 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 37/86] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:29:20 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1406 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 21:29:20.823011 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-0b871971-8f06-4662-8d3e-9cb1fbf3af8f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:20.831775 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-0b871971-8f06-4662-8d3e-9cb1fbf3af8f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1362 microversion: 2.1 time: 0.267913 May 03 21:29:20.832375 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 50/87] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:20 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1362 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:21.075778 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-1974037b-31ab-4875-869c-03bd014bac99 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:21.076977 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-1974037b-31ab-4875-869c-03bd014bac99 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:21.084547 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1974037b-31ab-4875-869c-03bd014bac99 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:21.085020 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1974037b-31ab-4875-869c-03bd014bac99 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:21.085790 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1974037b-31ab-4875-869c-03bd014bac99 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:21.086226 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1974037b-31ab-4875-869c-03bd014bac99 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:21.304604 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-1974037b-31ab-4875-869c-03bd014bac99 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:21.313966 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-1974037b-31ab-4875-869c-03bd014bac99 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14" status: 200 len: 1367 microversion: 2.1 time: 0.247878 May 03 21:29:21.314750 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 38/88] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:21 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14 => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:21.406374 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-4e20c4ff-e4e8-40f8-b3bc-58cae19d24e4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:21.409817 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-4e20c4ff-e4e8-40f8-b3bc-58cae19d24e4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:21.419176 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4e20c4ff-e4e8-40f8-b3bc-58cae19d24e4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:21.419710 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4e20c4ff-e4e8-40f8-b3bc-58cae19d24e4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:21.421249 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4e20c4ff-e4e8-40f8-b3bc-58cae19d24e4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:21.424030 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4e20c4ff-e4e8-40f8-b3bc-58cae19d24e4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:21.652345 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-4e20c4ff-e4e8-40f8-b3bc-58cae19d24e4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:21.661923 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-22c0fc2e-4d96-4111-83b6-d3369847dad7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:21.663095 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-22c0fc2e-4d96-4111-83b6-d3369847dad7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:21.671240 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-4e20c4ff-e4e8-40f8-b3bc-58cae19d24e4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1322 microversion: 2.1 time: 0.274843 May 03 21:29:21.672157 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 51/89] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:21 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:21.685404 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-22c0fc2e-4d96-4111-83b6-d3369847dad7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:21.688120 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-22c0fc2e-4d96-4111-83b6-d3369847dad7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:21.689890 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-22c0fc2e-4d96-4111-83b6-d3369847dad7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:21.690871 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-22c0fc2e-4d96-4111-83b6-d3369847dad7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:21.855943 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-46a3799b-e557-4b7f-b37a-d816b91d4498 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:21.856513 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-46a3799b-e557-4b7f-b37a-d816b91d4498 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:21.874505 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-46a3799b-e557-4b7f-b37a-d816b91d4498 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:21.875125 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-46a3799b-e557-4b7f-b37a-d816b91d4498 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:21.876353 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-46a3799b-e557-4b7f-b37a-d816b91d4498 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:21.876970 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-46a3799b-e557-4b7f-b37a-d816b91d4498 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:22.129882 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-46a3799b-e557-4b7f-b37a-d816b91d4498 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:22.138420 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-46a3799b-e557-4b7f-b37a-d816b91d4498 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1362 microversion: 2.1 time: 0.291707 May 03 21:29:22.139191 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 52/90] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:21 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1362 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:29:22.236765 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-22c0fc2e-4d96-4111-83b6-d3369847dad7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:22.250465 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-22c0fc2e-4d96-4111-83b6-d3369847dad7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:22.257912 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-22c0fc2e-4d96-4111-83b6-d3369847dad7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:22.258987 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-22c0fc2e-4d96-4111-83b6-d3369847dad7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1406 microversion: 2.20 time: 0.626908 May 03 21:29:22.259588 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 39/91] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:29:21 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1406 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:29:22.348383 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-466d3e78-a6e1-4893-a034-adf064225ae8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:22.349015 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-466d3e78-a6e1-4893-a034-adf064225ae8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:22.356158 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-466d3e78-a6e1-4893-a034-adf064225ae8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:22.356642 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-466d3e78-a6e1-4893-a034-adf064225ae8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:22.358125 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-466d3e78-a6e1-4893-a034-adf064225ae8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:22.358838 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-466d3e78-a6e1-4893-a034-adf064225ae8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:22.573284 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-466d3e78-a6e1-4893-a034-adf064225ae8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:22.582705 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-466d3e78-a6e1-4893-a034-adf064225ae8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14" status: 200 len: 1367 microversion: 2.1 time: 0.244246 May 03 21:29:22.583245 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 53/92] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:22 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14 => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:22.693676 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-ea1b98b4-f012-4e81-9cd1-10d832dc359b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:22.694281 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-ea1b98b4-f012-4e81-9cd1-10d832dc359b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:22.702254 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ea1b98b4-f012-4e81-9cd1-10d832dc359b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:22.702698 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ea1b98b4-f012-4e81-9cd1-10d832dc359b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:22.703560 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ea1b98b4-f012-4e81-9cd1-10d832dc359b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:22.703994 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ea1b98b4-f012-4e81-9cd1-10d832dc359b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:22.928098 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-ea1b98b4-f012-4e81-9cd1-10d832dc359b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:22.940356 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-ea1b98b4-f012-4e81-9cd1-10d832dc359b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1516 microversion: 2.1 time: 0.255870 May 03 21:29:22.941078 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 40/93] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:22 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1516 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:22.974334 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-d8a2e489-d042-4e03-9f2b-a99f2c2087f3 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:29:22.975361 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-d8a2e489-d042-4e03-9f2b-a99f2c2087f3 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:22.983540 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d8a2e489-d042-4e03-9f2b-a99f2c2087f3 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:22.983985 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d8a2e489-d042-4e03-9f2b-a99f2c2087f3 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:22.984778 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d8a2e489-d042-4e03-9f2b-a99f2c2087f3 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:22.985219 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d8a2e489-d042-4e03-9f2b-a99f2c2087f3 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:23.050476 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.objects.instance [None req-d8a2e489-d042-4e03-9f2b-a99f2c2087f3 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lazy-loading 'flavor' on Instance uuid 11444b4c-e752-4766-9e89-f57974330390 {{(pid=97832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 03 21:29:23.161145 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-04d72e77-3718-494f-b1cc-7a9179fea0e5 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:23.161669 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-04d72e77-3718-494f-b1cc-7a9179fea0e5 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:23.168778 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-04d72e77-3718-494f-b1cc-7a9179fea0e5 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:23.177695 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-04d72e77-3718-494f-b1cc-7a9179fea0e5 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:23.177695 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-04d72e77-3718-494f-b1cc-7a9179fea0e5 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:23.177695 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-04d72e77-3718-494f-b1cc-7a9179fea0e5 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:23.378978 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-04d72e77-3718-494f-b1cc-7a9179fea0e5 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:23.387028 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-04d72e77-3718-494f-b1cc-7a9179fea0e5 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1362 microversion: 2.1 time: 0.235125 May 03 21:29:23.397224 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 41/94] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:23 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:29:23.404750 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-53e5f346-fe2d-42d1-b9cf-7dcf25afad06 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:23.405371 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-53e5f346-fe2d-42d1-b9cf-7dcf25afad06 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:23.412790 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-53e5f346-fe2d-42d1-b9cf-7dcf25afad06 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:23.413182 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-53e5f346-fe2d-42d1-b9cf-7dcf25afad06 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:23.413954 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-53e5f346-fe2d-42d1-b9cf-7dcf25afad06 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:23.414384 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-53e5f346-fe2d-42d1-b9cf-7dcf25afad06 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:23.571897 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-d8a2e489-d042-4e03-9f2b-a99f2c2087f3 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "POST /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390/action" status: 200 len: 32 microversion: 2.1 time: 0.607391 May 03 21:29:23.572524 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 54/95] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 3 21:29:22 2022] POST /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390/action => generated 32 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 03 21:29:23.587995 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-d26fcb69-22b0-470f-b432-c82f927a7d92 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:23.588732 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-d26fcb69-22b0-470f-b432-c82f927a7d92 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:23.598680 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d26fcb69-22b0-470f-b432-c82f927a7d92 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:23.599127 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d26fcb69-22b0-470f-b432-c82f927a7d92 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:23.599943 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d26fcb69-22b0-470f-b432-c82f927a7d92 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:23.600377 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d26fcb69-22b0-470f-b432-c82f927a7d92 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:23.629332 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-53e5f346-fe2d-42d1-b9cf-7dcf25afad06 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:23.647453 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-53e5f346-fe2d-42d1-b9cf-7dcf25afad06 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:23.653567 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-53e5f346-fe2d-42d1-b9cf-7dcf25afad06 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:23.654694 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-53e5f346-fe2d-42d1-b9cf-7dcf25afad06 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1406 microversion: 2.20 time: 0.259132 May 03 21:29:23.655408 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 42/96] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:29:23 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1406 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:29:23.665696 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-661fde09-3e18-4669-a260-11c0eb8cf021 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:23.666513 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-661fde09-3e18-4669-a260-11c0eb8cf021 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:23.674211 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-661fde09-3e18-4669-a260-11c0eb8cf021 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:23.674873 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-661fde09-3e18-4669-a260-11c0eb8cf021 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:23.675821 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-661fde09-3e18-4669-a260-11c0eb8cf021 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:23.676407 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-661fde09-3e18-4669-a260-11c0eb8cf021 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:23.832059 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-d26fcb69-22b0-470f-b432-c82f927a7d92 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:23.842001 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-d26fcb69-22b0-470f-b432-c82f927a7d92 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1522 microversion: 2.1 time: 0.263754 May 03 21:29:23.842947 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 55/97] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:23 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:29:23.943560 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-661fde09-3e18-4669-a260-11c0eb8cf021 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:23.953181 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-661fde09-3e18-4669-a260-11c0eb8cf021 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14" status: 200 len: 1367 microversion: 2.1 time: 0.295281 May 03 21:29:23.953939 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 43/98] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:23 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14 => generated 1367 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:24.411517 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-5ba44db7-0a9e-4f70-ba0c-ea852c10a9ab tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:24.412123 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-5ba44db7-0a9e-4f70-ba0c-ea852c10a9ab tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:24.421574 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5ba44db7-0a9e-4f70-ba0c-ea852c10a9ab tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:24.422022 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5ba44db7-0a9e-4f70-ba0c-ea852c10a9ab tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:24.422912 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5ba44db7-0a9e-4f70-ba0c-ea852c10a9ab tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:24.423390 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5ba44db7-0a9e-4f70-ba0c-ea852c10a9ab tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:24.638500 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-5ba44db7-0a9e-4f70-ba0c-ea852c10a9ab tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:24.647739 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-5ba44db7-0a9e-4f70-ba0c-ea852c10a9ab tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1362 microversion: 2.1 time: 0.246569 May 03 21:29:24.648295 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 56/99] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:24 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:24.679104 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-015ca88e-ce2c-4be0-aa66-3a79f5692700 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:24.679713 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-015ca88e-ce2c-4be0-aa66-3a79f5692700 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:24.688208 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-015ca88e-ce2c-4be0-aa66-3a79f5692700 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:24.688711 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-015ca88e-ce2c-4be0-aa66-3a79f5692700 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:24.689559 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-015ca88e-ce2c-4be0-aa66-3a79f5692700 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:24.690000 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-015ca88e-ce2c-4be0-aa66-3a79f5692700 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:24.865891 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-62f3b082-904c-486e-941a-12d1dd55efca tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:24.875969 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-62f3b082-904c-486e-941a-12d1dd55efca tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:24.883008 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-62f3b082-904c-486e-941a-12d1dd55efca tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:24.883669 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-62f3b082-904c-486e-941a-12d1dd55efca tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:24.884651 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-62f3b082-904c-486e-941a-12d1dd55efca tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:24.885256 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-62f3b082-904c-486e-941a-12d1dd55efca tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:25.345235 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-62f3b082-904c-486e-941a-12d1dd55efca tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:25.354040 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-62f3b082-904c-486e-941a-12d1dd55efca tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1522 microversion: 2.1 time: 0.498571 May 03 21:29:25.364696 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 57/100] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:24 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1522 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:25.375766 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-d0275210-972c-49d0-99bc-07ea994b20ca tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:25.376409 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-d0275210-972c-49d0-99bc-07ea994b20ca tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:25.384457 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d0275210-972c-49d0-99bc-07ea994b20ca tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:25.392186 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d0275210-972c-49d0-99bc-07ea994b20ca tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:25.392186 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d0275210-972c-49d0-99bc-07ea994b20ca tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:25.392186 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d0275210-972c-49d0-99bc-07ea994b20ca tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:25.654793 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-015ca88e-ce2c-4be0-aa66-3a79f5692700 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:25.672014 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-015ca88e-ce2c-4be0-aa66-3a79f5692700 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:25.678785 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-015ca88e-ce2c-4be0-aa66-3a79f5692700 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:25.679881 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-015ca88e-ce2c-4be0-aa66-3a79f5692700 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1406 microversion: 2.20 time: 1.010550 May 03 21:29:25.692471 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 44/101] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:29:24 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1406 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:29:25.701145 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-929fbc56-1851-4530-95d8-7638a1a85d6c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:25.701767 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-929fbc56-1851-4530-95d8-7638a1a85d6c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:25.709394 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-929fbc56-1851-4530-95d8-7638a1a85d6c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:25.710178 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-929fbc56-1851-4530-95d8-7638a1a85d6c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:25.711172 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-929fbc56-1851-4530-95d8-7638a1a85d6c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:25.711611 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-929fbc56-1851-4530-95d8-7638a1a85d6c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:25.866401 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-d0275210-972c-49d0-99bc-07ea994b20ca tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:25.881838 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-d0275210-972c-49d0-99bc-07ea994b20ca tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14" status: 200 len: 1367 microversion: 2.1 time: 0.515886 May 03 21:29:25.884077 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 58/102] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:25 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14 => generated 1367 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:25.965134 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-ec9f719b-e3c7-48b3-84b8-0ec340bc9767 req-8e17ae97-4e57-4026-b86d-cfbe2bf8f170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12a46337-1502-4a61-8c0d-8b5dd98d5a14", "name": "network-vif-plugged", "status": "completed", "tag": "5c8533bd-9029-4055-8bb5-b5628053505e"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:29:25.972309 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:29:25.972309 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:29:25.980936 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-ec9f719b-e3c7-48b3-84b8-0ec340bc9767 req-8e17ae97-4e57-4026-b86d-cfbe2bf8f170 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:25.981478 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-ec9f719b-e3c7-48b3-84b8-0ec340bc9767 req-8e17ae97-4e57-4026-b86d-cfbe2bf8f170 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:25.999747 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-ec9f719b-e3c7-48b3-84b8-0ec340bc9767 req-8e17ae97-4e57-4026-b86d-cfbe2bf8f170 service nova] Creating event network-vif-plugged:5c8533bd-9029-4055-8bb5-b5628053505e for instance 12a46337-1502-4a61-8c0d-8b5dd98d5a14 on hv-cinder-84037 May 03 21:29:26.004467 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-ec9f719b-e3c7-48b3-84b8-0ec340bc9767 req-8e17ae97-4e57-4026-b86d-cfbe2bf8f170 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050262 May 03 21:29:26.005275 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 59/103] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:29:26.382141 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-536c652f-4818-4fdd-be95-367f0536edbc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:26.383377 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-536c652f-4818-4fdd-be95-367f0536edbc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:26.396263 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-536c652f-4818-4fdd-be95-367f0536edbc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:26.397120 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-536c652f-4818-4fdd-be95-367f0536edbc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:26.398269 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-536c652f-4818-4fdd-be95-367f0536edbc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:26.399576 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-536c652f-4818-4fdd-be95-367f0536edbc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:26.570513 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-929fbc56-1851-4530-95d8-7638a1a85d6c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:26.590172 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-929fbc56-1851-4530-95d8-7638a1a85d6c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1362 microversion: 2.1 time: 0.895982 May 03 21:29:26.594753 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 45/104] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:25 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1362 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:26.714908 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-fea4751d-2901-4db9-b9fc-1bff88a45a47 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:26.715904 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-fea4751d-2901-4db9-b9fc-1bff88a45a47 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:26.736090 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fea4751d-2901-4db9-b9fc-1bff88a45a47 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:26.736561 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fea4751d-2901-4db9-b9fc-1bff88a45a47 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:26.737562 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fea4751d-2901-4db9-b9fc-1bff88a45a47 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:26.737994 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fea4751d-2901-4db9-b9fc-1bff88a45a47 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:26.830355 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-536c652f-4818-4fdd-be95-367f0536edbc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:26.846213 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-536c652f-4818-4fdd-be95-367f0536edbc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1522 microversion: 2.1 time: 0.478390 May 03 21:29:26.847205 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 60/105] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:26 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1522 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:26.906695 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-9665f922-8e61-48f2-89b1-0737c3a56769 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:26.907469 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-9665f922-8e61-48f2-89b1-0737c3a56769 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:26.914972 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9665f922-8e61-48f2-89b1-0737c3a56769 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:26.915414 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9665f922-8e61-48f2-89b1-0737c3a56769 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:26.916186 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9665f922-8e61-48f2-89b1-0737c3a56769 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:26.916699 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9665f922-8e61-48f2-89b1-0737c3a56769 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:27.097450 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-fea4751d-2901-4db9-b9fc-1bff88a45a47 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:27.112305 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-fea4751d-2901-4db9-b9fc-1bff88a45a47 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:27.118811 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-fea4751d-2901-4db9-b9fc-1bff88a45a47 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:27.120177 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-fea4751d-2901-4db9-b9fc-1bff88a45a47 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1406 microversion: 2.20 time: 0.424513 May 03 21:29:27.120776 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 46/106] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:29:26 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1406 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 21:29:27.147743 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-9665f922-8e61-48f2-89b1-0737c3a56769 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:27.158768 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-9665f922-8e61-48f2-89b1-0737c3a56769 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14" status: 200 len: 1367 microversion: 2.1 time: 0.263293 May 03 21:29:27.179067 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 61/107] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:26 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14 => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:27.615951 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-728d6de6-581e-43c2-a0cf-4106e76a639b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:27.616585 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-728d6de6-581e-43c2-a0cf-4106e76a639b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:27.625391 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-728d6de6-581e-43c2-a0cf-4106e76a639b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:27.625799 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-728d6de6-581e-43c2-a0cf-4106e76a639b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:27.626593 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-728d6de6-581e-43c2-a0cf-4106e76a639b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:27.627030 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-728d6de6-581e-43c2-a0cf-4106e76a639b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:27.862419 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-728d6de6-581e-43c2-a0cf-4106e76a639b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:27.867632 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-728d6de6-581e-43c2-a0cf-4106e76a639b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1362 microversion: 2.1 time: 0.261181 May 03 21:29:27.868517 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 47/108] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:27 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1362 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:27.874947 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-2156365c-3315-4fe8-9de5-2ac73af9f81d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:27.875790 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-2156365c-3315-4fe8-9de5-2ac73af9f81d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:27.889251 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2156365c-3315-4fe8-9de5-2ac73af9f81d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:27.889251 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2156365c-3315-4fe8-9de5-2ac73af9f81d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:27.889251 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2156365c-3315-4fe8-9de5-2ac73af9f81d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:27.889251 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2156365c-3315-4fe8-9de5-2ac73af9f81d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:28.110031 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-2156365c-3315-4fe8-9de5-2ac73af9f81d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:28.118601 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-2156365c-3315-4fe8-9de5-2ac73af9f81d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1522 microversion: 2.1 time: 0.254804 May 03 21:29:28.123933 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 62/109] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:27 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:28.147181 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-a72c9b10-198a-40ef-b367-037f3fdc4cde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:28.147695 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-a72c9b10-198a-40ef-b367-037f3fdc4cde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:28.155725 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a72c9b10-198a-40ef-b367-037f3fdc4cde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:28.156181 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a72c9b10-198a-40ef-b367-037f3fdc4cde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:28.156996 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a72c9b10-198a-40ef-b367-037f3fdc4cde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:28.157429 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a72c9b10-198a-40ef-b367-037f3fdc4cde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:28.217382 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-41eaf0a4-81c3-4ba3-b586-60296aff8e28 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:28.218373 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-41eaf0a4-81c3-4ba3-b586-60296aff8e28 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:28.226407 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-41eaf0a4-81c3-4ba3-b586-60296aff8e28 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:28.227009 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-41eaf0a4-81c3-4ba3-b586-60296aff8e28 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:28.228040 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-41eaf0a4-81c3-4ba3-b586-60296aff8e28 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:28.228704 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-41eaf0a4-81c3-4ba3-b586-60296aff8e28 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:28.410292 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-a72c9b10-198a-40ef-b367-037f3fdc4cde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:28.428131 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-a72c9b10-198a-40ef-b367-037f3fdc4cde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:28.435165 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-a72c9b10-198a-40ef-b367-037f3fdc4cde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:28.437651 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-a72c9b10-198a-40ef-b367-037f3fdc4cde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1406 microversion: 2.20 time: 0.302171 May 03 21:29:28.438707 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 48/110] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:29:28 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1406 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:29:28.588913 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-41eaf0a4-81c3-4ba3-b586-60296aff8e28 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:28.602716 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-41eaf0a4-81c3-4ba3-b586-60296aff8e28 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14" status: 200 len: 1367 microversion: 2.1 time: 0.395391 May 03 21:29:28.603269 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 63/111] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:28 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14 => generated 1367 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:28.893092 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-63772808-0ee3-42ad-864d-923df22fdc1a tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:28.893727 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-63772808-0ee3-42ad-864d-923df22fdc1a tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:28.900952 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-63772808-0ee3-42ad-864d-923df22fdc1a tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:28.906815 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-63772808-0ee3-42ad-864d-923df22fdc1a tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:28.906815 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-63772808-0ee3-42ad-864d-923df22fdc1a tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:28.906815 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-63772808-0ee3-42ad-864d-923df22fdc1a tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:29.142192 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-659e81da-7814-43e6-9507-62656e9ee98d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:29.142976 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-659e81da-7814-43e6-9507-62656e9ee98d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:29.148287 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-63772808-0ee3-42ad-864d-923df22fdc1a tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:29.153170 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-659e81da-7814-43e6-9507-62656e9ee98d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:29.164041 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-659e81da-7814-43e6-9507-62656e9ee98d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:29.164041 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-659e81da-7814-43e6-9507-62656e9ee98d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:29.164041 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-659e81da-7814-43e6-9507-62656e9ee98d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:29.164377 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-63772808-0ee3-42ad-864d-923df22fdc1a tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1362 microversion: 2.1 time: 0.279716 May 03 21:29:29.164377 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 49/112] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:28 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1362 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:29:29.394378 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-659e81da-7814-43e6-9507-62656e9ee98d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:29.402570 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-659e81da-7814-43e6-9507-62656e9ee98d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1522 microversion: 2.1 time: 0.270675 May 03 21:29:29.404854 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 64/113] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:29 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:29.468251 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-5fe58969-298a-48f4-8920-812ea7599fcf tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:29.468251 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-5fe58969-298a-48f4-8920-812ea7599fcf tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:29.475586 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5fe58969-298a-48f4-8920-812ea7599fcf tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:29.476140 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5fe58969-298a-48f4-8920-812ea7599fcf tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:29.477161 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5fe58969-298a-48f4-8920-812ea7599fcf tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:29.477690 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5fe58969-298a-48f4-8920-812ea7599fcf tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:29.625835 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-f0c8042e-ad01-4f38-a30c-e49045d94e4e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:29.626458 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-f0c8042e-ad01-4f38-a30c-e49045d94e4e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:29.634246 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f0c8042e-ad01-4f38-a30c-e49045d94e4e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:29.634917 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f0c8042e-ad01-4f38-a30c-e49045d94e4e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:29.635697 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f0c8042e-ad01-4f38-a30c-e49045d94e4e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:29.636131 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f0c8042e-ad01-4f38-a30c-e49045d94e4e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:29.775834 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-5fe58969-298a-48f4-8920-812ea7599fcf tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:29.796611 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-5fe58969-298a-48f4-8920-812ea7599fcf tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:29.802925 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-5fe58969-298a-48f4-8920-812ea7599fcf tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:29.804179 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-5fe58969-298a-48f4-8920-812ea7599fcf tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1406 microversion: 2.20 time: 0.350501 May 03 21:29:29.805085 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 50/114] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:29:29 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1406 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:29:29.994883 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-f0c8042e-ad01-4f38-a30c-e49045d94e4e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:30.006864 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-f0c8042e-ad01-4f38-a30c-e49045d94e4e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14" status: 200 len: 1557 microversion: 2.1 time: 0.390821 May 03 21:29:30.007545 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 65/115] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:29 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14 => generated 1557 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:29:30.046150 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-0e131f5c-9027-4785-bd61-0aa147e2b3d9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:30.046688 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-0e131f5c-9027-4785-bd61-0aa147e2b3d9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:30.055041 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0e131f5c-9027-4785-bd61-0aa147e2b3d9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:30.055972 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0e131f5c-9027-4785-bd61-0aa147e2b3d9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:30.057524 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0e131f5c-9027-4785-bd61-0aa147e2b3d9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:30.058177 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0e131f5c-9027-4785-bd61-0aa147e2b3d9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:30.192058 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-27016f01-4781-47f4-b9cb-153c50b625e1 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:30.192969 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-27016f01-4781-47f4-b9cb-153c50b625e1 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:30.203910 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-27016f01-4781-47f4-b9cb-153c50b625e1 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:30.204308 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-27016f01-4781-47f4-b9cb-153c50b625e1 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:30.205304 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-27016f01-4781-47f4-b9cb-153c50b625e1 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:30.205847 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-27016f01-4781-47f4-b9cb-153c50b625e1 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:30.240102 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-0e131f5c-9027-4785-bd61-0aa147e2b3d9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.203677 May 03 21:29:30.241077 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 51/116] 10.222.0.48 () {58 vars in 1274 bytes} [Tue May 3 21:29:30 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14/os-interface => generated 285 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:29:30.432169 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-7888a02c-cdb1-4db4-b8fd-db249f12b91b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:30.433026 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-7888a02c-cdb1-4db4-b8fd-db249f12b91b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:30.443529 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7888a02c-cdb1-4db4-b8fd-db249f12b91b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:30.444202 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7888a02c-cdb1-4db4-b8fd-db249f12b91b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:30.445033 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7888a02c-cdb1-4db4-b8fd-db249f12b91b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:30.445551 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7888a02c-cdb1-4db4-b8fd-db249f12b91b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:30.486180 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-27016f01-4781-47f4-b9cb-153c50b625e1 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:30.497099 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-27016f01-4781-47f4-b9cb-153c50b625e1 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1362 microversion: 2.1 time: 0.319343 May 03 21:29:30.498793 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 66/117] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:30 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1362 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:30.831393 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-97f0d4fc-8774-454e-8071-e7ccaf5c15ee tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:30.832471 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-97f0d4fc-8774-454e-8071-e7ccaf5c15ee tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:30.841034 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-97f0d4fc-8774-454e-8071-e7ccaf5c15ee tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:30.841894 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-97f0d4fc-8774-454e-8071-e7ccaf5c15ee tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:30.842945 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-97f0d4fc-8774-454e-8071-e7ccaf5c15ee tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:30.843665 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-97f0d4fc-8774-454e-8071-e7ccaf5c15ee tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:31.111226 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-7888a02c-cdb1-4db4-b8fd-db249f12b91b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:31.127907 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-7888a02c-cdb1-4db4-b8fd-db249f12b91b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1522 microversion: 2.1 time: 0.710516 May 03 21:29:31.128603 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 52/118] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:30 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1522 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:31.138199 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-97f0d4fc-8774-454e-8071-e7ccaf5c15ee tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:31.161489 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-97f0d4fc-8774-454e-8071-e7ccaf5c15ee tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:31.171067 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-97f0d4fc-8774-454e-8071-e7ccaf5c15ee tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:31.172711 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-97f0d4fc-8774-454e-8071-e7ccaf5c15ee tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1406 microversion: 2.20 time: 0.353781 May 03 21:29:31.183620 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 67/119] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:29:30 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1406 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 21:29:31.528288 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-ae2a92a8-5aea-41f8-afa1-ff4690248946 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:31.529934 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-ae2a92a8-5aea-41f8-afa1-ff4690248946 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:31.538265 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ae2a92a8-5aea-41f8-afa1-ff4690248946 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:31.538751 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ae2a92a8-5aea-41f8-afa1-ff4690248946 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:31.539517 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ae2a92a8-5aea-41f8-afa1-ff4690248946 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:31.539953 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ae2a92a8-5aea-41f8-afa1-ff4690248946 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:31.967058 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-ae2a92a8-5aea-41f8-afa1-ff4690248946 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:31.978166 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-ae2a92a8-5aea-41f8-afa1-ff4690248946 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1362 microversion: 2.1 time: 0.465549 May 03 21:29:31.993742 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 53/120] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:31 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1362 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:32.163502 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-d17e789a-51fc-4e37-aa59-c51e7f4a560a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:32.164126 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-d17e789a-51fc-4e37-aa59-c51e7f4a560a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:32.175508 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d17e789a-51fc-4e37-aa59-c51e7f4a560a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:32.176236 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d17e789a-51fc-4e37-aa59-c51e7f4a560a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:32.177190 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d17e789a-51fc-4e37-aa59-c51e7f4a560a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:32.177762 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d17e789a-51fc-4e37-aa59-c51e7f4a560a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:32.178102 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-4084c051-04a3-4a76-a0b6-1bdb2585c364 req-4fef91d4-6262-4290-b646-7842fa4d93b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "274fd6f3-1f2e-4da8-8c5f-fa173514fc2a", "name": "network-vif-plugged", "status": "completed", "tag": "46d7aa18-8157-45ea-b292-6af9e591723f"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:29:32.191108 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:29:32.191108 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:29:32.201955 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-4084c051-04a3-4a76-a0b6-1bdb2585c364 req-4fef91d4-6262-4290-b646-7842fa4d93b9 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:32.205217 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-4084c051-04a3-4a76-a0b6-1bdb2585c364 req-4fef91d4-6262-4290-b646-7842fa4d93b9 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:32.224550 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-4084c051-04a3-4a76-a0b6-1bdb2585c364 req-4fef91d4-6262-4290-b646-7842fa4d93b9 service nova] Creating event network-vif-plugged:46d7aa18-8157-45ea-b292-6af9e591723f for instance 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a on hv-cinder-84037 May 03 21:29:32.231266 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-4084c051-04a3-4a76-a0b6-1bdb2585c364 req-4fef91d4-6262-4290-b646-7842fa4d93b9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074519 May 03 21:29:32.234867 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 54/121] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:29:32.247397 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-a0c5264a-7ee2-417b-b9c7-ba56708fa6c0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:32.248784 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-a0c5264a-7ee2-417b-b9c7-ba56708fa6c0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:32.257627 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a0c5264a-7ee2-417b-b9c7-ba56708fa6c0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:32.258340 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a0c5264a-7ee2-417b-b9c7-ba56708fa6c0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:32.259128 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a0c5264a-7ee2-417b-b9c7-ba56708fa6c0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:32.259563 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a0c5264a-7ee2-417b-b9c7-ba56708fa6c0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:32.590658 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-d17e789a-51fc-4e37-aa59-c51e7f4a560a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:32.601731 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-d17e789a-51fc-4e37-aa59-c51e7f4a560a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1522 microversion: 2.1 time: 0.458066 May 03 21:29:32.602690 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-a0c5264a-7ee2-417b-b9c7-ba56708fa6c0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:32.610675 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 68/122] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:32 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1522 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:32.622371 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-a0c5264a-7ee2-417b-b9c7-ba56708fa6c0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:32.626073 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-a0c5264a-7ee2-417b-b9c7-ba56708fa6c0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:32.627209 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-a0c5264a-7ee2-417b-b9c7-ba56708fa6c0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1406 microversion: 2.20 time: 0.390902 May 03 21:29:32.627787 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 55/123] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:29:32 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1406 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:29:33.004464 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-362bf9e2-31be-48f1-85c8-89e3d3cb49c8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:33.005083 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-362bf9e2-31be-48f1-85c8-89e3d3cb49c8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:33.020186 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-362bf9e2-31be-48f1-85c8-89e3d3cb49c8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:33.022453 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-362bf9e2-31be-48f1-85c8-89e3d3cb49c8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:33.022453 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-362bf9e2-31be-48f1-85c8-89e3d3cb49c8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:33.022453 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-362bf9e2-31be-48f1-85c8-89e3d3cb49c8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:33.283581 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-582ede52-439e-495e-89b5-6133274a6315 req-02e77d3d-267e-4bc9-9b11-c7eb33a634bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12a46337-1502-4a61-8c0d-8b5dd98d5a14", "tag": "5c8533bd-9029-4055-8bb5-b5628053505e"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:29:33.290843 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:29:33.290843 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:29:33.299771 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-582ede52-439e-495e-89b5-6133274a6315 req-02e77d3d-267e-4bc9-9b11-c7eb33a634bf service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:33.301607 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-582ede52-439e-495e-89b5-6133274a6315 req-02e77d3d-267e-4bc9-9b11-c7eb33a634bf service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:33.317985 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-582ede52-439e-495e-89b5-6133274a6315 req-02e77d3d-267e-4bc9-9b11-c7eb33a634bf service nova] Creating event network-changed:5c8533bd-9029-4055-8bb5-b5628053505e for instance 12a46337-1502-4a61-8c0d-8b5dd98d5a14 on hv-cinder-84037 May 03 21:29:33.322716 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-582ede52-439e-495e-89b5-6133274a6315 req-02e77d3d-267e-4bc9-9b11-c7eb33a634bf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049408 May 03 21:29:33.323314 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 56/124] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:29:33.371247 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-362bf9e2-31be-48f1-85c8-89e3d3cb49c8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:33.383581 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-362bf9e2-31be-48f1-85c8-89e3d3cb49c8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1362 microversion: 2.1 time: 0.391679 May 03 21:29:33.384486 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 69/125] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:32 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1362 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:33.637471 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-ec61fec2-1f6f-4b6e-9721-eecd8d8c8c0c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:33.638271 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-ec61fec2-1f6f-4b6e-9721-eecd8d8c8c0c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:33.647398 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ec61fec2-1f6f-4b6e-9721-eecd8d8c8c0c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:33.647806 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ec61fec2-1f6f-4b6e-9721-eecd8d8c8c0c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:33.648628 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ec61fec2-1f6f-4b6e-9721-eecd8d8c8c0c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:33.649067 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ec61fec2-1f6f-4b6e-9721-eecd8d8c8c0c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:33.659563 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-9379ad84-11a7-423f-9f3e-cc1bc250786a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:33.660651 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-9379ad84-11a7-423f-9f3e-cc1bc250786a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:33.670972 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9379ad84-11a7-423f-9f3e-cc1bc250786a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:33.671726 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9379ad84-11a7-423f-9f3e-cc1bc250786a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:33.672826 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9379ad84-11a7-423f-9f3e-cc1bc250786a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:33.673667 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9379ad84-11a7-423f-9f3e-cc1bc250786a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:33.932112 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-9379ad84-11a7-423f-9f3e-cc1bc250786a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:33.948805 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-9379ad84-11a7-423f-9f3e-cc1bc250786a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:33.956364 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-9379ad84-11a7-423f-9f3e-cc1bc250786a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:33.957927 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-9379ad84-11a7-423f-9f3e-cc1bc250786a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1406 microversion: 2.20 time: 0.313938 May 03 21:29:33.958570 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 70/126] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:29:33 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1406 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:29:34.264670 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-ec61fec2-1f6f-4b6e-9721-eecd8d8c8c0c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:34.279469 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-ec61fec2-1f6f-4b6e-9721-eecd8d8c8c0c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1522 microversion: 2.1 time: 0.659594 May 03 21:29:34.280495 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 57/127] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:33 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1522 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:34.407793 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-af6cb2aa-5461-465a-adda-12b074862e6c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:34.408519 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-af6cb2aa-5461-465a-adda-12b074862e6c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:34.415874 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-af6cb2aa-5461-465a-adda-12b074862e6c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:34.416322 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-af6cb2aa-5461-465a-adda-12b074862e6c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:34.417204 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-af6cb2aa-5461-465a-adda-12b074862e6c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:34.417642 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-af6cb2aa-5461-465a-adda-12b074862e6c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:34.762414 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-af6cb2aa-5461-465a-adda-12b074862e6c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:34.770603 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-af6cb2aa-5461-465a-adda-12b074862e6c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1362 microversion: 2.1 time: 0.373424 May 03 21:29:34.771366 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 71/128] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:34 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1362 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:29:34.985027 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-f79e56eb-4f3d-422e-b495-d92d0d02c268 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:34.985909 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-f79e56eb-4f3d-422e-b495-d92d0d02c268 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:34.994686 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f79e56eb-4f3d-422e-b495-d92d0d02c268 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:34.995287 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f79e56eb-4f3d-422e-b495-d92d0d02c268 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:34.996176 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f79e56eb-4f3d-422e-b495-d92d0d02c268 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:34.996875 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f79e56eb-4f3d-422e-b495-d92d0d02c268 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:35.302281 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-7ccfed8e-2b51-46d5-8f29-1b667a8b4d22 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:35.302911 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-7ccfed8e-2b51-46d5-8f29-1b667a8b4d22 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:35.311808 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7ccfed8e-2b51-46d5-8f29-1b667a8b4d22 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:35.312264 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7ccfed8e-2b51-46d5-8f29-1b667a8b4d22 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:35.313084 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7ccfed8e-2b51-46d5-8f29-1b667a8b4d22 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:35.313528 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7ccfed8e-2b51-46d5-8f29-1b667a8b4d22 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:35.447850 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-f79e56eb-4f3d-422e-b495-d92d0d02c268 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:35.475705 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-f79e56eb-4f3d-422e-b495-d92d0d02c268 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:35.482226 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-f79e56eb-4f3d-422e-b495-d92d0d02c268 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:35.483531 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-f79e56eb-4f3d-422e-b495-d92d0d02c268 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1406 microversion: 2.20 time: 0.511022 May 03 21:29:35.484779 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 58/129] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:29:34 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1406 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:29:35.576609 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-7ccfed8e-2b51-46d5-8f29-1b667a8b4d22 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:35.589466 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-7ccfed8e-2b51-46d5-8f29-1b667a8b4d22 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1522 microversion: 2.1 time: 0.295720 May 03 21:29:35.592097 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 72/130] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:35 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:29:35.794896 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-f38588bb-e7d8-4ca2-8f32-cf431b5150ad tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:35.795779 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-f38588bb-e7d8-4ca2-8f32-cf431b5150ad tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:35.804555 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f38588bb-e7d8-4ca2-8f32-cf431b5150ad tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:35.805022 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f38588bb-e7d8-4ca2-8f32-cf431b5150ad tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:35.806195 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f38588bb-e7d8-4ca2-8f32-cf431b5150ad tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:35.808614 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f38588bb-e7d8-4ca2-8f32-cf431b5150ad tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:36.069322 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-04c97943-533c-491d-bf2d-2d0063165247 req-f01d27bb-dc3c-4bae-98ae-b203b8ed1f5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f6a8a2-4366-486d-a002-05587e0f46b5", "name": "network-vif-plugged", "status": "completed", "tag": "be428a12-3d87-4da1-a665-e7b79df6af66"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:29:36.087467 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:29:36.087467 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:29:36.098324 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-04c97943-533c-491d-bf2d-2d0063165247 req-f01d27bb-dc3c-4bae-98ae-b203b8ed1f5d service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:36.099008 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-04c97943-533c-491d-bf2d-2d0063165247 req-f01d27bb-dc3c-4bae-98ae-b203b8ed1f5d service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:36.144398 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-04c97943-533c-491d-bf2d-2d0063165247 req-f01d27bb-dc3c-4bae-98ae-b203b8ed1f5d service nova] Creating event network-vif-plugged:be428a12-3d87-4da1-a665-e7b79df6af66 for instance 77f6a8a2-4366-486d-a002-05587e0f46b5 on hv-cinder-84037 May 03 21:29:36.150549 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-04c97943-533c-491d-bf2d-2d0063165247 req-f01d27bb-dc3c-4bae-98ae-b203b8ed1f5d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098320 May 03 21:29:36.151391 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 73/131] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:29:36.226900 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-f38588bb-e7d8-4ca2-8f32-cf431b5150ad tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:36.251341 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-f38588bb-e7d8-4ca2-8f32-cf431b5150ad tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1548 microversion: 2.1 time: 0.464769 May 03 21:29:36.252068 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 59/132] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:35 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1548 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:36.274750 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-71ed12bf-153e-4e60-a953-10fe1a045f02 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:36.275352 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-71ed12bf-153e-4e60-a953-10fe1a045f02 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:36.284463 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-71ed12bf-153e-4e60-a953-10fe1a045f02 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:36.284463 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-71ed12bf-153e-4e60-a953-10fe1a045f02 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:36.285229 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-71ed12bf-153e-4e60-a953-10fe1a045f02 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:36.285649 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-71ed12bf-153e-4e60-a953-10fe1a045f02 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:36.451080 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-71ed12bf-153e-4e60-a953-10fe1a045f02 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.185873 May 03 21:29:36.451765 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 74/133] 10.222.0.48 () {58 vars in 1274 bytes} [Tue May 3 21:29:36 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a/os-interface => generated 285 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:29:36.514879 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-4d02bedc-059d-4c7d-95cf-5b492f524202 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:36.516239 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-4d02bedc-059d-4c7d-95cf-5b492f524202 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:36.525293 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4d02bedc-059d-4c7d-95cf-5b492f524202 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:36.532445 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4d02bedc-059d-4c7d-95cf-5b492f524202 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:36.532445 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4d02bedc-059d-4c7d-95cf-5b492f524202 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:36.532445 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4d02bedc-059d-4c7d-95cf-5b492f524202 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:36.616461 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-e60c1c06-8389-4692-b336-2921293b05a8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:36.621366 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-e60c1c06-8389-4692-b336-2921293b05a8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:36.638105 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e60c1c06-8389-4692-b336-2921293b05a8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:36.644699 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e60c1c06-8389-4692-b336-2921293b05a8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:36.646837 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e60c1c06-8389-4692-b336-2921293b05a8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:36.649224 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e60c1c06-8389-4692-b336-2921293b05a8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:36.963851 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-e60c1c06-8389-4692-b336-2921293b05a8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:36.987259 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-e60c1c06-8389-4692-b336-2921293b05a8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1522 microversion: 2.1 time: 0.381624 May 03 21:29:36.987927 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 75/134] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:36 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1522 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:29:37.016861 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-faf059fb-2711-441b-97fa-14dbb9940a22 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:37.018299 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-faf059fb-2711-441b-97fa-14dbb9940a22 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] [instance: 7ae08669-d95f-432b-bc27-265833de050d] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:37.030508 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-faf059fb-2711-441b-97fa-14dbb9940a22 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:37.031592 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-faf059fb-2711-441b-97fa-14dbb9940a22 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:37.032725 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-faf059fb-2711-441b-97fa-14dbb9940a22 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:37.033381 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-faf059fb-2711-441b-97fa-14dbb9940a22 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:37.129848 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-faf059fb-2711-441b-97fa-14dbb9940a22 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] [instance: 7ae08669-d95f-432b-bc27-265833de050d] Going to try to terminate instance {{(pid=97832) delete /opt/stack/nova/nova/compute/api.py:2559}} May 03 21:29:37.402459 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-4d02bedc-059d-4c7d-95cf-5b492f524202 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:37.433974 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-4d02bedc-059d-4c7d-95cf-5b492f524202 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:37.440742 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-4d02bedc-059d-4c7d-95cf-5b492f524202 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:37.442304 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-4d02bedc-059d-4c7d-95cf-5b492f524202 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1406 microversion: 2.20 time: 0.938200 May 03 21:29:37.443037 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 60/135] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:29:36 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1406 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:29:37.955509 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-faf059fb-2711-441b-97fa-14dbb9940a22 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d" status: 204 len: 0 microversion: 2.1 time: 0.953505 May 03 21:29:37.956911 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 76/136] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 3 21:29:36 2022] DELETE /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d => generated 0 bytes in 957 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 03 21:29:37.971342 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-94e25694-a8aa-45c8-9cc1-0fce70fa035f tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:37.971978 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-94e25694-a8aa-45c8-9cc1-0fce70fa035f tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] [instance: 7ae08669-d95f-432b-bc27-265833de050d] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:37.979341 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-94e25694-a8aa-45c8-9cc1-0fce70fa035f tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:37.979845 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-94e25694-a8aa-45c8-9cc1-0fce70fa035f tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:37.980673 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-94e25694-a8aa-45c8-9cc1-0fce70fa035f tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:37.981109 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-94e25694-a8aa-45c8-9cc1-0fce70fa035f tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:38.023710 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-9575c7fe-0461-4195-95b8-6e7bd11152d8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:38.024441 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-9575c7fe-0461-4195-95b8-6e7bd11152d8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:38.048946 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9575c7fe-0461-4195-95b8-6e7bd11152d8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:38.049413 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9575c7fe-0461-4195-95b8-6e7bd11152d8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:38.050467 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9575c7fe-0461-4195-95b8-6e7bd11152d8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:38.051516 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9575c7fe-0461-4195-95b8-6e7bd11152d8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:38.319469 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-9575c7fe-0461-4195-95b8-6e7bd11152d8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:38.329956 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-9575c7fe-0461-4195-95b8-6e7bd11152d8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1522 microversion: 2.1 time: 0.325260 May 03 21:29:38.330710 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 77/137] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:38 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:38.343294 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-32d9e4df-7a89-4f5c-a050-ee3acec4bafc tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-119581289", "imageRef": "f5214328-64f1-4aa6-aa05-61f0189e0e1e", "flavorRef": "452", "networks": [{"uuid": "1bd6e5c5-0c32-4b7c-912b-8ae1c3143665"}]}} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:29:38.421755 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.network.neutron [None req-32d9e4df-7a89-4f5c-a050-ee3acec4bafc tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] validate_networks() for [('1bd6e5c5-0c32-4b7c-912b-8ae1c3143665', None, None, None)] {{(pid=97832) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} May 03 21:29:38.502656 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-94e25694-a8aa-45c8-9cc1-0fce70fa035f tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d5d87a502542b6b1215ad2f2531fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ad2a8e2573405fa636364bdf765504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:38.518920 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-94e25694-a8aa-45c8-9cc1-0fce70fa035f tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] 10.222.0.48 "GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d" status: 200 len: 1555 microversion: 2.1 time: 0.558167 May 03 21:29:38.520715 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 61/138] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:37 2022] GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d => generated 1555 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:29:38.542163 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-f5b2831f-7f9d-453a-917e-3fccda0dbf2e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:38.542745 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-f5b2831f-7f9d-453a-917e-3fccda0dbf2e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:38.550672 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f5b2831f-7f9d-453a-917e-3fccda0dbf2e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:38.551126 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f5b2831f-7f9d-453a-917e-3fccda0dbf2e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:38.551899 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f5b2831f-7f9d-453a-917e-3fccda0dbf2e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:38.552330 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f5b2831f-7f9d-453a-917e-3fccda0dbf2e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:38.843663 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-f5b2831f-7f9d-453a-917e-3fccda0dbf2e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:38.868893 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-f5b2831f-7f9d-453a-917e-3fccda0dbf2e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:38.879040 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-f5b2831f-7f9d-453a-917e-3fccda0dbf2e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:38.885017 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-f5b2831f-7f9d-453a-917e-3fccda0dbf2e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1406 microversion: 2.20 time: 0.348529 May 03 21:29:38.885017 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 62/139] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:29:38 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1406 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:29:39.165840 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-32d9e4df-7a89-4f5c-a050-ee3acec4bafc tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Flavor limits 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} May 03 21:29:39.166554 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-32d9e4df-7a89-4f5c-a050-ee3acec4bafc tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Image limits 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} May 03 21:29:39.166713 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-32d9e4df-7a89-4f5c-a050-ee3acec4bafc tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Flavor pref 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} May 03 21:29:39.167394 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-32d9e4df-7a89-4f5c-a050-ee3acec4bafc tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Image pref 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} May 03 21:29:39.167889 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-32d9e4df-7a89-4f5c-a050-ee3acec4bafc tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} May 03 21:29:39.178827 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-32d9e4df-7a89-4f5c-a050-ee3acec4bafc tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:39.179274 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-32d9e4df-7a89-4f5c-a050-ee3acec4bafc tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:39.180839 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-32d9e4df-7a89-4f5c-a050-ee3acec4bafc tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:39.181723 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-32d9e4df-7a89-4f5c-a050-ee3acec4bafc tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:39.202918 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-32d9e4df-7a89-4f5c-a050-ee3acec4bafc tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Getting quotas for project 103e27d9374d41689ceff14ee5a5ae21. Resources: {'instances', 'ram', 'cores'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:29:39.204326 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-e3598133-34da-469d-b780-1a56122bebe8 req-aabe0caa-a167-4ff8-b2c6-001b6914cb80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "274fd6f3-1f2e-4da8-8c5f-fa173514fc2a", "tag": "46d7aa18-8157-45ea-b292-6af9e591723f"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:29:39.207235 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-32d9e4df-7a89-4f5c-a050-ee3acec4bafc tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Getting quotas for user 237395ade5344a7eba25fdd620c165f9 and project 103e27d9374d41689ceff14ee5a5ae21. Resources: {'instances', 'ram', 'cores'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:29:39.211948 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:29:39.211948 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:29:39.218908 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-32d9e4df-7a89-4f5c-a050-ee3acec4bafc tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Going to run 1 instances... {{(pid=97832) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} May 03 21:29:39.221322 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-32d9e4df-7a89-4f5c-a050-ee3acec4bafc tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 71fcec7c-c868-4296-b92d-704179c12e86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5214328-64f1-4aa6-aa05-61f0189e0e1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=97832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} May 03 21:29:39.222300 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-e3598133-34da-469d-b780-1a56122bebe8 req-aabe0caa-a167-4ff8-b2c6-001b6914cb80 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:39.222945 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-e3598133-34da-469d-b780-1a56122bebe8 req-aabe0caa-a167-4ff8-b2c6-001b6914cb80 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:39.241582 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-e3598133-34da-469d-b780-1a56122bebe8 req-aabe0caa-a167-4ff8-b2c6-001b6914cb80 service nova] Creating event network-changed:46d7aa18-8157-45ea-b292-6af9e591723f for instance 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a on hv-cinder-84037 May 03 21:29:39.246593 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-e3598133-34da-469d-b780-1a56122bebe8 req-aabe0caa-a167-4ff8-b2c6-001b6914cb80 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054022 May 03 21:29:39.251089 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 63/140] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:29:39.363764 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-15c4b2b9-f77d-4ba6-b9fc-3980cad87c40 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:39.364508 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-15c4b2b9-f77d-4ba6-b9fc-3980cad87c40 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:39.373483 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-15c4b2b9-f77d-4ba6-b9fc-3980cad87c40 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:39.374398 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-15c4b2b9-f77d-4ba6-b9fc-3980cad87c40 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:39.375534 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-15c4b2b9-f77d-4ba6-b9fc-3980cad87c40 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:39.376123 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-15c4b2b9-f77d-4ba6-b9fc-3980cad87c40 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:39.393106 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-32d9e4df-7a89-4f5c-a050-ee3acec4bafc tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.060868 May 03 21:29:39.393988 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 78/141] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 3 21:29:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 03 21:29:39.425626 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-776a6576-648f-4513-86ce-5b94b268a318 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:39.426998 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-776a6576-648f-4513-86ce-5b94b268a318 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 71fcec7c-c868-4296-b92d-704179c12e86] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:39.563698 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-776a6576-648f-4513-86ce-5b94b268a318 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:39.572626 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-776a6576-648f-4513-86ce-5b94b268a318 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86" status: 200 len: 1218 microversion: 2.1 time: 0.171715 May 03 21:29:39.573158 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 79/142] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:39 2022] GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86 => generated 1218 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:29:39.584077 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-509974fc-9930-4480-b1c6-102b48ef774e tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:39.584797 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-509974fc-9930-4480-b1c6-102b48ef774e tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] [instance: 7ae08669-d95f-432b-bc27-265833de050d] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:39.637041 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-509974fc-9930-4480-b1c6-102b48ef774e tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:39.637041 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-509974fc-9930-4480-b1c6-102b48ef774e tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:39.637041 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-509974fc-9930-4480-b1c6-102b48ef774e tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:39.637041 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-509974fc-9930-4480-b1c6-102b48ef774e tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:39.860137 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-15c4b2b9-f77d-4ba6-b9fc-3980cad87c40 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:39.871030 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-15c4b2b9-f77d-4ba6-b9fc-3980cad87c40 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1522 microversion: 2.1 time: 0.519782 May 03 21:29:39.883696 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-509974fc-9930-4480-b1c6-102b48ef774e tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d5d87a502542b6b1215ad2f2531fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ad2a8e2573405fa636364bdf765504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:39.884629 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 64/143] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:39 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1522 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:39.890235 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-509974fc-9930-4480-b1c6-102b48ef774e tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] 10.222.0.48 "GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d" status: 200 len: 1555 microversion: 2.1 time: 0.316031 May 03 21:29:39.890909 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 80/144] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:39 2022] GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d => generated 1555 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:39.910978 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-267150f9-52a4-4e3b-911e-4d021f3e67aa tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:39.911594 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-267150f9-52a4-4e3b-911e-4d021f3e67aa tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:39.918986 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-267150f9-52a4-4e3b-911e-4d021f3e67aa tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:39.920070 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-267150f9-52a4-4e3b-911e-4d021f3e67aa tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:39.932461 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-267150f9-52a4-4e3b-911e-4d021f3e67aa tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:39.932461 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-267150f9-52a4-4e3b-911e-4d021f3e67aa tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:40.278108 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-267150f9-52a4-4e3b-911e-4d021f3e67aa tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:40.292117 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-267150f9-52a4-4e3b-911e-4d021f3e67aa tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:40.299602 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-267150f9-52a4-4e3b-911e-4d021f3e67aa tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:40.300957 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-267150f9-52a4-4e3b-911e-4d021f3e67aa tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1599 microversion: 2.20 time: 0.399451 May 03 21:29:40.301489 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 65/145] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:29:39 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1599 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:29:40.328338 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-56ab4568-6f98-4f0d-bf6d-72180c27011b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:40.328900 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-56ab4568-6f98-4f0d-bf6d-72180c27011b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:40.336407 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-56ab4568-6f98-4f0d-bf6d-72180c27011b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:40.337096 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-56ab4568-6f98-4f0d-bf6d-72180c27011b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:40.338100 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-56ab4568-6f98-4f0d-bf6d-72180c27011b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:40.338762 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-56ab4568-6f98-4f0d-bf6d-72180c27011b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:40.496683 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-56ab4568-6f98-4f0d-bf6d-72180c27011b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.180786 May 03 21:29:40.497364 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 81/146] 10.222.0.48 () {60 vars in 1315 bytes} [Tue May 3 21:29:40 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5/os-interface => generated 285 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 21:29:40.607355 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-21a57011-9855-4d9b-84dd-d2d80b4abed7 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:40.609129 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-21a57011-9855-4d9b-84dd-d2d80b4abed7 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 71fcec7c-c868-4296-b92d-704179c12e86] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:40.789143 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-21a57011-9855-4d9b-84dd-d2d80b4abed7 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:40.799625 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-21a57011-9855-4d9b-84dd-d2d80b4abed7 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86" status: 200 len: 1218 microversion: 2.1 time: 0.212080 May 03 21:29:40.800367 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 66/147] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:40 2022] GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86 => generated 1218 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:40.899473 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-9f399037-f59d-46bc-a2ce-945802efd4c5 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:40.900176 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-9f399037-f59d-46bc-a2ce-945802efd4c5 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:40.910664 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9f399037-f59d-46bc-a2ce-945802efd4c5 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:40.911235 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9f399037-f59d-46bc-a2ce-945802efd4c5 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:40.912198 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9f399037-f59d-46bc-a2ce-945802efd4c5 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:40.912705 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9f399037-f59d-46bc-a2ce-945802efd4c5 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:40.914558 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-d4b23f7e-2918-4c09-836a-52df168355fa tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:40.915869 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-d4b23f7e-2918-4c09-836a-52df168355fa tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] [instance: 7ae08669-d95f-432b-bc27-265833de050d] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:40.924170 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d4b23f7e-2918-4c09-836a-52df168355fa tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:40.924863 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d4b23f7e-2918-4c09-836a-52df168355fa tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:40.931602 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d4b23f7e-2918-4c09-836a-52df168355fa tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:40.931602 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d4b23f7e-2918-4c09-836a-52df168355fa tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:41.223990 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-9f399037-f59d-46bc-a2ce-945802efd4c5 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:41.238078 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-9f399037-f59d-46bc-a2ce-945802efd4c5 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1522 microversion: 2.1 time: 0.350210 May 03 21:29:41.239656 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 82/148] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:40 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:41.449238 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-d4b23f7e-2918-4c09-836a-52df168355fa tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d5d87a502542b6b1215ad2f2531fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ad2a8e2573405fa636364bdf765504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:41.460702 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-d4b23f7e-2918-4c09-836a-52df168355fa tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] 10.222.0.48 "GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d" status: 200 len: 1555 microversion: 2.1 time: 0.557263 May 03 21:29:41.461555 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 67/149] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:40 2022] GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d => generated 1555 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:29:41.823006 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-9e8fcdeb-713d-4178-90ec-bee592d05915 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:41.823631 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-9e8fcdeb-713d-4178-90ec-bee592d05915 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 71fcec7c-c868-4296-b92d-704179c12e86] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:41.831347 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9e8fcdeb-713d-4178-90ec-bee592d05915 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:41.831825 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9e8fcdeb-713d-4178-90ec-bee592d05915 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:41.832687 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9e8fcdeb-713d-4178-90ec-bee592d05915 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:41.833053 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9e8fcdeb-713d-4178-90ec-bee592d05915 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:42.044618 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-9e8fcdeb-713d-4178-90ec-bee592d05915 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:42.053960 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-9e8fcdeb-713d-4178-90ec-bee592d05915 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86" status: 200 len: 1222 microversion: 2.1 time: 0.240101 May 03 21:29:42.064873 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 83/150] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:41 2022] GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86 => generated 1222 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:42.275275 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-37fe9758-0760-43d8-ae26-d1a18f7ef387 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:42.276000 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-37fe9758-0760-43d8-ae26-d1a18f7ef387 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:42.284499 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-37fe9758-0760-43d8-ae26-d1a18f7ef387 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:42.284957 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-37fe9758-0760-43d8-ae26-d1a18f7ef387 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:42.285734 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-37fe9758-0760-43d8-ae26-d1a18f7ef387 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:42.286171 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-37fe9758-0760-43d8-ae26-d1a18f7ef387 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:42.487041 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-1732d2b3-b2f0-459e-ab6a-d9a035a3843f tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:42.488155 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-1732d2b3-b2f0-459e-ab6a-d9a035a3843f tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] [instance: 7ae08669-d95f-432b-bc27-265833de050d] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:42.496297 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-1732d2b3-b2f0-459e-ab6a-d9a035a3843f tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:42.497017 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-1732d2b3-b2f0-459e-ab6a-d9a035a3843f tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:42.498551 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-1732d2b3-b2f0-459e-ab6a-d9a035a3843f tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:42.499351 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-1732d2b3-b2f0-459e-ab6a-d9a035a3843f tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:42.596713 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-37fe9758-0760-43d8-ae26-d1a18f7ef387 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:42.605908 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-37fe9758-0760-43d8-ae26-d1a18f7ef387 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1522 microversion: 2.1 time: 0.340750 May 03 21:29:42.606956 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 68/151] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:42 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1522 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:42.810517 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-1732d2b3-b2f0-459e-ab6a-d9a035a3843f tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d5d87a502542b6b1215ad2f2531fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ad2a8e2573405fa636364bdf765504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:42.820675 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-1732d2b3-b2f0-459e-ab6a-d9a035a3843f tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] 10.222.0.48 "GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d" status: 200 len: 1555 microversion: 2.1 time: 0.345792 May 03 21:29:42.821616 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 84/152] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:42 2022] GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d => generated 1555 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:29:43.006057 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-2cb26bb5-ba59-48d2-8ad1-1c0b34d45a05 req-efd8a22f-8110-470e-8025-1eaf59397b10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77f6a8a2-4366-486d-a002-05587e0f46b5", "tag": "be428a12-3d87-4da1-a665-e7b79df6af66"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:29:43.013033 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:29:43.013033 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:29:43.022829 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-2cb26bb5-ba59-48d2-8ad1-1c0b34d45a05 req-efd8a22f-8110-470e-8025-1eaf59397b10 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:43.023315 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-2cb26bb5-ba59-48d2-8ad1-1c0b34d45a05 req-efd8a22f-8110-470e-8025-1eaf59397b10 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:43.040747 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-2cb26bb5-ba59-48d2-8ad1-1c0b34d45a05 req-efd8a22f-8110-470e-8025-1eaf59397b10 service nova] Creating event network-changed:be428a12-3d87-4da1-a665-e7b79df6af66 for instance 77f6a8a2-4366-486d-a002-05587e0f46b5 on hv-cinder-84037 May 03 21:29:43.048382 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-2cb26bb5-ba59-48d2-8ad1-1c0b34d45a05 req-efd8a22f-8110-470e-8025-1eaf59397b10 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059223 May 03 21:29:43.048762 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 69/153] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:29:43.083077 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-2da1a061-9767-473f-841e-8829300ec360 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:43.083743 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-2da1a061-9767-473f-841e-8829300ec360 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 71fcec7c-c868-4296-b92d-704179c12e86] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:43.094699 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2da1a061-9767-473f-841e-8829300ec360 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:43.094699 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2da1a061-9767-473f-841e-8829300ec360 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:43.095190 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2da1a061-9767-473f-841e-8829300ec360 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:43.095415 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2da1a061-9767-473f-841e-8829300ec360 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:43.273817 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-2da1a061-9767-473f-841e-8829300ec360 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:43.285409 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-2da1a061-9767-473f-841e-8829300ec360 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86" status: 200 len: 1222 microversion: 2.1 time: 0.215213 May 03 21:29:43.286501 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 85/154] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:43 2022] GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86 => generated 1222 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:43.633572 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-1b8403c9-2f78-4b05-ba3f-775b0263f7e0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:43.635125 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-1b8403c9-2f78-4b05-ba3f-775b0263f7e0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:43.647695 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1b8403c9-2f78-4b05-ba3f-775b0263f7e0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:43.648332 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1b8403c9-2f78-4b05-ba3f-775b0263f7e0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:43.649421 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1b8403c9-2f78-4b05-ba3f-775b0263f7e0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:43.650491 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1b8403c9-2f78-4b05-ba3f-775b0263f7e0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:43.849274 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-e7dfead2-0c56-42fd-82b5-cc9b65f50c13 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:43.849940 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-e7dfead2-0c56-42fd-82b5-cc9b65f50c13 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] [instance: 7ae08669-d95f-432b-bc27-265833de050d] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:43.858050 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e7dfead2-0c56-42fd-82b5-cc9b65f50c13 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:43.858891 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e7dfead2-0c56-42fd-82b5-cc9b65f50c13 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:43.859832 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e7dfead2-0c56-42fd-82b5-cc9b65f50c13 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:43.860359 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e7dfead2-0c56-42fd-82b5-cc9b65f50c13 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:43.936279 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-1b8403c9-2f78-4b05-ba3f-775b0263f7e0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:43.970789 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-1b8403c9-2f78-4b05-ba3f-775b0263f7e0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1522 microversion: 2.1 time: 0.348522 May 03 21:29:43.971637 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 70/155] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:43 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1522 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:44.189766 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-e7dfead2-0c56-42fd-82b5-cc9b65f50c13 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d5d87a502542b6b1215ad2f2531fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ad2a8e2573405fa636364bdf765504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:44.206791 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-e7dfead2-0c56-42fd-82b5-cc9b65f50c13 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] 10.222.0.48 "GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d" status: 200 len: 1555 microversion: 2.1 time: 0.367164 May 03 21:29:44.208308 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 86/156] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:43 2022] GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d => generated 1555 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:29:44.313696 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-880cce60-dc57-40ed-97e6-aa25c717b12b tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:44.314861 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-880cce60-dc57-40ed-97e6-aa25c717b12b tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 71fcec7c-c868-4296-b92d-704179c12e86] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:44.332232 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-880cce60-dc57-40ed-97e6-aa25c717b12b tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:44.333219 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-880cce60-dc57-40ed-97e6-aa25c717b12b tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:44.334318 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-880cce60-dc57-40ed-97e6-aa25c717b12b tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:44.334969 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-880cce60-dc57-40ed-97e6-aa25c717b12b tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:44.612110 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-880cce60-dc57-40ed-97e6-aa25c717b12b tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:44.637249 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-880cce60-dc57-40ed-97e6-aa25c717b12b tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86" status: 200 len: 1214 microversion: 2.1 time: 0.337441 May 03 21:29:44.649391 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 71/157] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:44 2022] GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86 => generated 1214 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:45.007100 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-4bee0bf7-9ca3-4ca0-a66b-9c6a48c8f93b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:45.007770 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-4bee0bf7-9ca3-4ca0-a66b-9c6a48c8f93b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:45.041023 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4bee0bf7-9ca3-4ca0-a66b-9c6a48c8f93b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:45.041821 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4bee0bf7-9ca3-4ca0-a66b-9c6a48c8f93b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:45.044795 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4bee0bf7-9ca3-4ca0-a66b-9c6a48c8f93b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:45.045502 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4bee0bf7-9ca3-4ca0-a66b-9c6a48c8f93b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:45.241446 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-69ec3414-870d-4a00-bf18-da79b85369d6 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:45.245870 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-69ec3414-870d-4a00-bf18-da79b85369d6 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] [instance: 7ae08669-d95f-432b-bc27-265833de050d] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:45.271506 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-69ec3414-870d-4a00-bf18-da79b85369d6 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:45.272411 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-69ec3414-870d-4a00-bf18-da79b85369d6 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:45.275392 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-69ec3414-870d-4a00-bf18-da79b85369d6 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:45.276570 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-69ec3414-870d-4a00-bf18-da79b85369d6 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:45.710548 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-4bee0bf7-9ca3-4ca0-a66b-9c6a48c8f93b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:45.732046 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-4bee0bf7-9ca3-4ca0-a66b-9c6a48c8f93b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1522 microversion: 2.1 time: 0.740262 May 03 21:29:45.735129 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 87/158] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:44 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1522 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:45.770284 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-51f90c29-31bd-4923-a311-debfa686f9ad tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:45.773277 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-51f90c29-31bd-4923-a311-debfa686f9ad tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 71fcec7c-c868-4296-b92d-704179c12e86] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:45.784597 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-51f90c29-31bd-4923-a311-debfa686f9ad tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:45.785343 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-51f90c29-31bd-4923-a311-debfa686f9ad tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:45.791176 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-51f90c29-31bd-4923-a311-debfa686f9ad tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:45.791176 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-51f90c29-31bd-4923-a311-debfa686f9ad tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:46.004464 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-51f90c29-31bd-4923-a311-debfa686f9ad tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:46.018351 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-51f90c29-31bd-4923-a311-debfa686f9ad tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86" status: 200 len: 1278 microversion: 2.1 time: 0.281655 May 03 21:29:46.019969 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 88/159] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:45 2022] GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86 => generated 1278 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:46.740749 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-362ed7b6-3e88-4870-a7b9-ccbd7390f6c9 req-80327684-f88a-4560-8e2a-44d27962e286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ae08669-d95f-432b-bc27-265833de050d", "name": "network-vif-unplugged", "status": "completed", "tag": "99d8b720-a305-456d-805e-84e960517e14"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:29:46.756343 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:29:46.756343 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:29:46.769890 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-362ed7b6-3e88-4870-a7b9-ccbd7390f6c9 req-80327684-f88a-4560-8e2a-44d27962e286 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:46.772111 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-362ed7b6-3e88-4870-a7b9-ccbd7390f6c9 req-80327684-f88a-4560-8e2a-44d27962e286 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:46.814300 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-362ed7b6-3e88-4870-a7b9-ccbd7390f6c9 req-80327684-f88a-4560-8e2a-44d27962e286 service nova] Creating event network-vif-unplugged:99d8b720-a305-456d-805e-84e960517e14 for instance 7ae08669-d95f-432b-bc27-265833de050d on hv-cinder-84037 May 03 21:29:46.821462 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-362ed7b6-3e88-4870-a7b9-ccbd7390f6c9 req-80327684-f88a-4560-8e2a-44d27962e286 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096517 May 03 21:29:46.822542 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 89/160] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:29:46.834662 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-84715161-0cf6-4d5e-97b8-537aab216dde tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:46.838511 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-84715161-0cf6-4d5e-97b8-537aab216dde tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:46.844242 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-84715161-0cf6-4d5e-97b8-537aab216dde tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:46.845050 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-84715161-0cf6-4d5e-97b8-537aab216dde tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:46.846066 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-84715161-0cf6-4d5e-97b8-537aab216dde tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:46.846698 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-84715161-0cf6-4d5e-97b8-537aab216dde tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:46.954415 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-69ec3414-870d-4a00-bf18-da79b85369d6 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d5d87a502542b6b1215ad2f2531fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ad2a8e2573405fa636364bdf765504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:46.979706 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-69ec3414-870d-4a00-bf18-da79b85369d6 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] 10.222.0.48 "GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d" status: 200 len: 1555 microversion: 2.1 time: 1.754174 May 03 21:29:46.984951 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 72/161] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:45 2022] GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d => generated 1555 bytes in 1760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:47.049652 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-f969bd15-7983-4f87-bb74-5fa309c2bcde tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:47.050275 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-f969bd15-7983-4f87-bb74-5fa309c2bcde tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 71fcec7c-c868-4296-b92d-704179c12e86] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:47.080754 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f969bd15-7983-4f87-bb74-5fa309c2bcde tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:47.082229 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f969bd15-7983-4f87-bb74-5fa309c2bcde tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:47.084232 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f969bd15-7983-4f87-bb74-5fa309c2bcde tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:47.086563 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f969bd15-7983-4f87-bb74-5fa309c2bcde tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:47.302962 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-84715161-0cf6-4d5e-97b8-537aab216dde tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:47.314505 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-84715161-0cf6-4d5e-97b8-537aab216dde tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1522 microversion: 2.1 time: 0.490327 May 03 21:29:47.315167 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 90/162] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:46 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1522 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:47.371402 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-f969bd15-7983-4f87-bb74-5fa309c2bcde tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:47.386215 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-f969bd15-7983-4f87-bb74-5fa309c2bcde tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86" status: 200 len: 1276 microversion: 2.1 time: 0.351856 May 03 21:29:47.390995 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 73/163] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:47 2022] GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86 => generated 1276 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:29:48.008339 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-ca1959c9-c2c9-4091-bb5a-884e1af34459 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:48.013479 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-ca1959c9-c2c9-4091-bb5a-884e1af34459 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] [instance: 7ae08669-d95f-432b-bc27-265833de050d] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:48.026531 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ca1959c9-c2c9-4091-bb5a-884e1af34459 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:48.026984 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ca1959c9-c2c9-4091-bb5a-884e1af34459 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:48.027770 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ca1959c9-c2c9-4091-bb5a-884e1af34459 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:48.034031 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ca1959c9-c2c9-4091-bb5a-884e1af34459 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:48.339460 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-f88e4f99-8e78-4038-b2af-f6a0eaf4b008 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:48.344875 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-f88e4f99-8e78-4038-b2af-f6a0eaf4b008 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:48.372803 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f88e4f99-8e78-4038-b2af-f6a0eaf4b008 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:48.380635 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f88e4f99-8e78-4038-b2af-f6a0eaf4b008 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:48.381946 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f88e4f99-8e78-4038-b2af-f6a0eaf4b008 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:48.384819 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f88e4f99-8e78-4038-b2af-f6a0eaf4b008 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:48.469957 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-ca1959c9-c2c9-4091-bb5a-884e1af34459 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d5d87a502542b6b1215ad2f2531fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ad2a8e2573405fa636364bdf765504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:48.495216 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-ca1959c9-c2c9-4091-bb5a-884e1af34459 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] 10.222.0.48 "GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d" status: 200 len: 1555 microversion: 2.1 time: 0.497000 May 03 21:29:48.496140 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 91/164] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:47 2022] GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d => generated 1555 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:48.533976 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-7074a3da-daf5-49d5-90fa-7c40bab209e0 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:48.535582 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-7074a3da-daf5-49d5-90fa-7c40bab209e0 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 71fcec7c-c868-4296-b92d-704179c12e86] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:48.546854 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7074a3da-daf5-49d5-90fa-7c40bab209e0 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:48.547734 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7074a3da-daf5-49d5-90fa-7c40bab209e0 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:48.549185 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7074a3da-daf5-49d5-90fa-7c40bab209e0 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:48.550034 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7074a3da-daf5-49d5-90fa-7c40bab209e0 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:48.709137 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-7074a3da-daf5-49d5-90fa-7c40bab209e0 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:48.718319 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-7074a3da-daf5-49d5-90fa-7c40bab209e0 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86" status: 200 len: 1276 microversion: 2.1 time: 0.207602 May 03 21:29:48.719137 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 92/165] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:48 2022] GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86 => generated 1276 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:48.870182 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-f88e4f99-8e78-4038-b2af-f6a0eaf4b008 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:48.887662 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-f88e4f99-8e78-4038-b2af-f6a0eaf4b008 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1522 microversion: 2.1 time: 0.558697 May 03 21:29:48.900119 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 74/166] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:48 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1522 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:29:49.083161 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-a49c52b6-d2d9-4b1b-b511-614ce266ffd6 req-9bd69db2-dbba-4393-b8d1-1570853f11ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ae08669-d95f-432b-bc27-265833de050d", "name": "network-vif-deleted", "tag": "99d8b720-a305-456d-805e-84e960517e14"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:29:49.108419 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:29:49.108419 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:29:49.122409 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-a49c52b6-d2d9-4b1b-b511-614ce266ffd6 req-9bd69db2-dbba-4393-b8d1-1570853f11ac service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:49.123198 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-a49c52b6-d2d9-4b1b-b511-614ce266ffd6 req-9bd69db2-dbba-4393-b8d1-1570853f11ac service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:49.143866 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-a49c52b6-d2d9-4b1b-b511-614ce266ffd6 req-9bd69db2-dbba-4393-b8d1-1570853f11ac service nova] Creating event network-vif-deleted:99d8b720-a305-456d-805e-84e960517e14 for instance 7ae08669-d95f-432b-bc27-265833de050d on hv-cinder-84037 May 03 21:29:49.150485 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-a49c52b6-d2d9-4b1b-b511-614ce266ffd6 req-9bd69db2-dbba-4393-b8d1-1570853f11ac service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080348 May 03 21:29:49.151250 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 93/167] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:29:49.536933 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-32903b9c-80b8-4350-9fb5-682a65efeaf3 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:49.538126 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-32903b9c-80b8-4350-9fb5-682a65efeaf3 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] [instance: 7ae08669-d95f-432b-bc27-265833de050d] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:49.563183 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-32903b9c-80b8-4350-9fb5-682a65efeaf3 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:49.563183 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-32903b9c-80b8-4350-9fb5-682a65efeaf3 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:49.563183 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-32903b9c-80b8-4350-9fb5-682a65efeaf3 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:49.563183 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-32903b9c-80b8-4350-9fb5-682a65efeaf3 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:49.749202 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-5965290a-dc7e-4317-8977-8ce6acd765bb tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:49.750154 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-5965290a-dc7e-4317-8977-8ce6acd765bb tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 71fcec7c-c868-4296-b92d-704179c12e86] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:49.762751 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5965290a-dc7e-4317-8977-8ce6acd765bb tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:49.763639 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5965290a-dc7e-4317-8977-8ce6acd765bb tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:49.764523 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5965290a-dc7e-4317-8977-8ce6acd765bb tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:49.765552 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5965290a-dc7e-4317-8977-8ce6acd765bb tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:49.955850 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-32903b9c-80b8-4350-9fb5-682a65efeaf3 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d5d87a502542b6b1215ad2f2531fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ad2a8e2573405fa636364bdf765504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:49.969655 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-32903b9c-80b8-4350-9fb5-682a65efeaf3 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] 10.222.0.48 "GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d" status: 200 len: 1346 microversion: 2.1 time: 0.450372 May 03 21:29:49.972184 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 75/168] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:49 2022] GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d => generated 1346 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:49.985287 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-9c8eee2e-aeac-4f8a-aebc-12319c9ac4e6 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:49.988291 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-9c8eee2e-aeac-4f8a-aebc-12319c9ac4e6 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:50.003811 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9c8eee2e-aeac-4f8a-aebc-12319c9ac4e6 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:50.003811 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9c8eee2e-aeac-4f8a-aebc-12319c9ac4e6 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:50.003811 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9c8eee2e-aeac-4f8a-aebc-12319c9ac4e6 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:50.007063 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9c8eee2e-aeac-4f8a-aebc-12319c9ac4e6 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:50.353475 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-5965290a-dc7e-4317-8977-8ce6acd765bb tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:50.367851 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-5965290a-dc7e-4317-8977-8ce6acd765bb tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86" status: 200 len: 1318 microversion: 2.1 time: 0.636323 May 03 21:29:50.370129 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 94/169] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:49 2022] GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86 => generated 1318 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:29:50.515023 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-9c8eee2e-aeac-4f8a-aebc-12319c9ac4e6 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:50.523381 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-9c8eee2e-aeac-4f8a-aebc-12319c9ac4e6 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1522 microversion: 2.1 time: 0.551546 May 03 21:29:50.524200 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 76/170] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:49 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1522 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:50.993683 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-6ae55093-b1ff-45a9-8303-8007840be411 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:50.994618 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-6ae55093-b1ff-45a9-8303-8007840be411 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] [instance: 7ae08669-d95f-432b-bc27-265833de050d] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:51.003101 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6ae55093-b1ff-45a9-8303-8007840be411 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:51.003828 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6ae55093-b1ff-45a9-8303-8007840be411 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:51.005041 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6ae55093-b1ff-45a9-8303-8007840be411 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:51.006008 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6ae55093-b1ff-45a9-8303-8007840be411 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:51.097455 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6ae55093-b1ff-45a9-8303-8007840be411 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:51.097455 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6ae55093-b1ff-45a9-8303-8007840be411 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:51.097455 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.objects.instance [None req-6ae55093-b1ff-45a9-8303-8007840be411 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lazy-loading 'fault' on Instance uuid 7ae08669-d95f-432b-bc27-265833de050d {{(pid=97832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 03 21:29:51.180391 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-14d9f9e3-cf02-46a4-8701-9e3b87f33c82 req-1db46c7d-8b9e-4e34-b140-586281190ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71fcec7c-c868-4296-b92d-704179c12e86", "tag": "846556a2-6669-4bf4-8f43-d938bc645197"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:29:51.187711 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:29:51.187711 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:29:51.206552 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-6ae55093-b1ff-45a9-8303-8007840be411 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d5d87a502542b6b1215ad2f2531fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ad2a8e2573405fa636364bdf765504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:51.209879 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-6ae55093-b1ff-45a9-8303-8007840be411 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] 10.222.0.48 "GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d" status: 200 len: 1351 microversion: 2.1 time: 0.225405 May 03 21:29:51.210434 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 95/171] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:50 2022] GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d => generated 1351 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:51.225705 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-14d9f9e3-cf02-46a4-8701-9e3b87f33c82 req-1db46c7d-8b9e-4e34-b140-586281190ec5 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:51.226487 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-14d9f9e3-cf02-46a4-8701-9e3b87f33c82 req-1db46c7d-8b9e-4e34-b140-586281190ec5 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:51.248663 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-14d9f9e3-cf02-46a4-8701-9e3b87f33c82 req-1db46c7d-8b9e-4e34-b140-586281190ec5 service nova] Creating event network-changed:846556a2-6669-4bf4-8f43-d938bc645197 for instance 71fcec7c-c868-4296-b92d-704179c12e86 on hv-cinder-84037 May 03 21:29:51.257470 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-14d9f9e3-cf02-46a4-8701-9e3b87f33c82 req-1db46c7d-8b9e-4e34-b140-586281190ec5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089443 May 03 21:29:51.257470 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 77/172] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:29:51.395463 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-d5e66c29-ea17-4524-8556-9938fb0436ff tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:51.396146 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-d5e66c29-ea17-4524-8556-9938fb0436ff tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 71fcec7c-c868-4296-b92d-704179c12e86] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:51.404748 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d5e66c29-ea17-4524-8556-9938fb0436ff tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:51.405464 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d5e66c29-ea17-4524-8556-9938fb0436ff tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:51.406254 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d5e66c29-ea17-4524-8556-9938fb0436ff tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:51.406689 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d5e66c29-ea17-4524-8556-9938fb0436ff tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:51.562447 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-e11cb9ea-6af9-4555-bc53-413f3712ad18 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:51.565216 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-e11cb9ea-6af9-4555-bc53-413f3712ad18 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:51.586346 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e11cb9ea-6af9-4555-bc53-413f3712ad18 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:51.586805 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e11cb9ea-6af9-4555-bc53-413f3712ad18 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:51.587600 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e11cb9ea-6af9-4555-bc53-413f3712ad18 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:51.589266 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e11cb9ea-6af9-4555-bc53-413f3712ad18 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:51.774245 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-d5e66c29-ea17-4524-8556-9938fb0436ff tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:51.787171 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-d5e66c29-ea17-4524-8556-9938fb0436ff tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86" status: 200 len: 1318 microversion: 2.1 time: 0.403676 May 03 21:29:51.791476 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 96/173] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:51 2022] GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86 => generated 1318 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:52.054935 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-e11cb9ea-6af9-4555-bc53-413f3712ad18 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:52.064305 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-e11cb9ea-6af9-4555-bc53-413f3712ad18 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1522 microversion: 2.1 time: 0.522423 May 03 21:29:52.074210 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 78/174] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:51 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1522 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:52.232619 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-bbcb8a8c-5e89-4b36-aff6-a321c5d90f07 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:52.233321 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-bbcb8a8c-5e89-4b36-aff6-a321c5d90f07 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] [instance: 7ae08669-d95f-432b-bc27-265833de050d] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:52.241229 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-bbcb8a8c-5e89-4b36-aff6-a321c5d90f07 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:52.241677 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-bbcb8a8c-5e89-4b36-aff6-a321c5d90f07 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:52.242458 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-bbcb8a8c-5e89-4b36-aff6-a321c5d90f07 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:52.242897 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-bbcb8a8c-5e89-4b36-aff6-a321c5d90f07 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:52.294531 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.wsgi [None req-bbcb8a8c-5e89-4b36-aff6-a321c5d90f07 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] HTTP exception thrown: Instance 7ae08669-d95f-432b-bc27-265833de050d could not be found. May 03 21:29:52.295133 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-bbcb8a8c-5e89-4b36-aff6-a321c5d90f07 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Returning 404 to user: Instance 7ae08669-d95f-432b-bc27-265833de050d could not be found. {{(pid=97832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:29:52.295953 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-bbcb8a8c-5e89-4b36-aff6-a321c5d90f07 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] 10.222.0.48 "GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d" status: 404 len: 111 microversion: 2.1 time: 0.072600 May 03 21:29:52.296528 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 97/175] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:52 2022] GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 21:29:52.493341 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-5f27e77b-1667-4c4b-9f66-c185da6e6c9a tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:52.494289 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-5f27e77b-1667-4c4b-9f66-c185da6e6c9a tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] [instance: 7ae08669-d95f-432b-bc27-265833de050d] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:52.505190 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5f27e77b-1667-4c4b-9f66-c185da6e6c9a tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:52.506667 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5f27e77b-1667-4c4b-9f66-c185da6e6c9a tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:52.507792 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5f27e77b-1667-4c4b-9f66-c185da6e6c9a tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:52.508417 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5f27e77b-1667-4c4b-9f66-c185da6e6c9a tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:52.568604 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.wsgi [None req-5f27e77b-1667-4c4b-9f66-c185da6e6c9a tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] HTTP exception thrown: Instance 7ae08669-d95f-432b-bc27-265833de050d could not be found. May 03 21:29:52.569333 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-5f27e77b-1667-4c4b-9f66-c185da6e6c9a tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Returning 404 to user: Instance 7ae08669-d95f-432b-bc27-265833de050d could not be found. {{(pid=97831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:29:52.570267 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-5f27e77b-1667-4c4b-9f66-c185da6e6c9a tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] 10.222.0.48 "GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.087333 May 03 21:29:52.571243 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 79/176] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 3 21:29:52 2022] GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d/os-volume_attachments => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 21:29:52.816273 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-6ceaf3a9-3be9-43be-9595-5c4812ec5a92 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:52.816273 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-6ceaf3a9-3be9-43be-9595-5c4812ec5a92 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 71fcec7c-c868-4296-b92d-704179c12e86] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:52.823381 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6ceaf3a9-3be9-43be-9595-5c4812ec5a92 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:52.823820 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6ceaf3a9-3be9-43be-9595-5c4812ec5a92 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:52.824838 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6ceaf3a9-3be9-43be-9595-5c4812ec5a92 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:52.825284 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6ceaf3a9-3be9-43be-9595-5c4812ec5a92 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:53.095198 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-02f1d6b2-b52e-407a-9ef0-93869e5ba008 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:53.100505 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-02f1d6b2-b52e-407a-9ef0-93869e5ba008 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:53.115631 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-02f1d6b2-b52e-407a-9ef0-93869e5ba008 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:53.116178 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-02f1d6b2-b52e-407a-9ef0-93869e5ba008 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:53.117058 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-02f1d6b2-b52e-407a-9ef0-93869e5ba008 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:53.117561 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-02f1d6b2-b52e-407a-9ef0-93869e5ba008 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:53.171074 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-6ceaf3a9-3be9-43be-9595-5c4812ec5a92 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:53.180533 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-6ceaf3a9-3be9-43be-9595-5c4812ec5a92 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86" status: 200 len: 1318 microversion: 2.1 time: 0.375445 May 03 21:29:53.181796 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 98/177] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:52 2022] GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86 => generated 1318 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:53.425503 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-02f1d6b2-b52e-407a-9ef0-93869e5ba008 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:53.433889 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-02f1d6b2-b52e-407a-9ef0-93869e5ba008 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1522 microversion: 2.1 time: 0.351985 May 03 21:29:53.435158 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 80/178] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:53 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:54.217677 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-b3cafa7d-8d14-4f06-b12d-e891687193e5 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:54.218403 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-b3cafa7d-8d14-4f06-b12d-e891687193e5 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 71fcec7c-c868-4296-b92d-704179c12e86] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:54.225678 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b3cafa7d-8d14-4f06-b12d-e891687193e5 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:54.226162 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b3cafa7d-8d14-4f06-b12d-e891687193e5 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:54.226934 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b3cafa7d-8d14-4f06-b12d-e891687193e5 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:54.227361 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b3cafa7d-8d14-4f06-b12d-e891687193e5 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:54.349598 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-e13bb138-1c59-4d54-9a6b-a660e1809547 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:54.350120 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-e13bb138-1c59-4d54-9a6b-a660e1809547 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] [instance: 7ae08669-d95f-432b-bc27-265833de050d] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:54.361510 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e13bb138-1c59-4d54-9a6b-a660e1809547 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:54.361782 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e13bb138-1c59-4d54-9a6b-a660e1809547 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:54.362715 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e13bb138-1c59-4d54-9a6b-a660e1809547 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:54.363160 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e13bb138-1c59-4d54-9a6b-a660e1809547 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:54.431264 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.wsgi [None req-e13bb138-1c59-4d54-9a6b-a660e1809547 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] HTTP exception thrown: Instance 7ae08669-d95f-432b-bc27-265833de050d could not be found. May 03 21:29:54.431264 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-e13bb138-1c59-4d54-9a6b-a660e1809547 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Returning 404 to user: Instance 7ae08669-d95f-432b-bc27-265833de050d could not be found. {{(pid=97831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:29:54.431264 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-e13bb138-1c59-4d54-9a6b-a660e1809547 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d" status: 404 len: 111 microversion: 2.1 time: 0.095279 May 03 21:29:54.431264 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 81/179] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 3 21:29:54 2022] DELETE /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 21:29:54.443360 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-b2b51c2d-6152-4d43-a355-82370a0718a3 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:54.443985 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-b2b51c2d-6152-4d43-a355-82370a0718a3 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] [instance: 7ae08669-d95f-432b-bc27-265833de050d] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:54.452934 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b2b51c2d-6152-4d43-a355-82370a0718a3 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:54.459065 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b2b51c2d-6152-4d43-a355-82370a0718a3 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:54.459065 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b2b51c2d-6152-4d43-a355-82370a0718a3 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:54.459065 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b2b51c2d-6152-4d43-a355-82370a0718a3 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:54.501037 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-b3cafa7d-8d14-4f06-b12d-e891687193e5 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:54.509178 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.wsgi [None req-b2b51c2d-6152-4d43-a355-82370a0718a3 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] HTTP exception thrown: Instance 7ae08669-d95f-432b-bc27-265833de050d could not be found. May 03 21:29:54.509808 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-b2b51c2d-6152-4d43-a355-82370a0718a3 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] Returning 404 to user: Instance 7ae08669-d95f-432b-bc27-265833de050d could not be found. {{(pid=97831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:29:54.510635 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-b2b51c2d-6152-4d43-a355-82370a0718a3 tempest-DeleteServersTestJSON-1257599601 tempest-DeleteServersTestJSON-1257599601-project] 10.222.0.48 "GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d" status: 404 len: 111 microversion: 2.1 time: 0.078956 May 03 21:29:54.515257 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 82/180] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:54 2022] GET /compute/v2.1/servers/7ae08669-d95f-432b-bc27-265833de050d => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 21:29:54.519374 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-b3cafa7d-8d14-4f06-b12d-e891687193e5 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86" status: 200 len: 1318 microversion: 2.1 time: 0.307903 May 03 21:29:54.522057 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-40c29555-f9f6-4f2e-bc85-f0966bb86f0a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:54.522876 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-40c29555-f9f6-4f2e-bc85-f0966bb86f0a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:54.526709 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 99/181] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:54 2022] GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86 => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:54.531584 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-40c29555-f9f6-4f2e-bc85-f0966bb86f0a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:54.532034 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-40c29555-f9f6-4f2e-bc85-f0966bb86f0a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:54.532876 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-40c29555-f9f6-4f2e-bc85-f0966bb86f0a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:54.533309 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-40c29555-f9f6-4f2e-bc85-f0966bb86f0a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:54.854413 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-40c29555-f9f6-4f2e-bc85-f0966bb86f0a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:54.868204 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-40c29555-f9f6-4f2e-bc85-f0966bb86f0a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1522 microversion: 2.1 time: 0.355698 May 03 21:29:54.869182 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 83/182] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:54 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1522 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:55.540516 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-700a485c-55e6-4cb4-827a-354b5090c4be tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:55.541191 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-700a485c-55e6-4cb4-827a-354b5090c4be tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 71fcec7c-c868-4296-b92d-704179c12e86] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:55.548906 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-700a485c-55e6-4cb4-827a-354b5090c4be tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:55.549552 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-700a485c-55e6-4cb4-827a-354b5090c4be tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:55.550321 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-700a485c-55e6-4cb4-827a-354b5090c4be tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:55.550740 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-700a485c-55e6-4cb4-827a-354b5090c4be tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:55.767987 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-700a485c-55e6-4cb4-827a-354b5090c4be tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:55.774284 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-700a485c-55e6-4cb4-827a-354b5090c4be tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86" status: 200 len: 1318 microversion: 2.1 time: 0.243195 May 03 21:29:55.775145 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 100/183] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:55 2022] GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:55.900913 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-bcf3f9ec-9d54-400a-8fe3-424934ed51f3 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:55.901808 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-bcf3f9ec-9d54-400a-8fe3-424934ed51f3 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:55.909482 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-bcf3f9ec-9d54-400a-8fe3-424934ed51f3 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:55.909930 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-bcf3f9ec-9d54-400a-8fe3-424934ed51f3 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:55.910728 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-bcf3f9ec-9d54-400a-8fe3-424934ed51f3 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:55.911204 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-bcf3f9ec-9d54-400a-8fe3-424934ed51f3 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:56.155692 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-bcf3f9ec-9d54-400a-8fe3-424934ed51f3 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:56.165605 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-bcf3f9ec-9d54-400a-8fe3-424934ed51f3 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1522 microversion: 2.1 time: 0.277918 May 03 21:29:56.166288 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 84/184] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:55 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:56.797956 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-c16a8c57-9d24-476b-b592-031428675541 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:56.798551 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-c16a8c57-9d24-476b-b592-031428675541 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 71fcec7c-c868-4296-b92d-704179c12e86] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:56.806102 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c16a8c57-9d24-476b-b592-031428675541 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:56.806553 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c16a8c57-9d24-476b-b592-031428675541 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:56.807328 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c16a8c57-9d24-476b-b592-031428675541 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:56.807769 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c16a8c57-9d24-476b-b592-031428675541 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:57.062434 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-c16a8c57-9d24-476b-b592-031428675541 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:57.084507 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-c16a8c57-9d24-476b-b592-031428675541 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86" status: 200 len: 1318 microversion: 2.1 time: 0.296005 May 03 21:29:57.086485 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 101/185] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:56 2022] GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86 => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:57.189552 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-6dee4d41-0d7c-4884-a468-ee4e81f52e78 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:57.190165 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-6dee4d41-0d7c-4884-a468-ee4e81f52e78 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:57.197641 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6dee4d41-0d7c-4884-a468-ee4e81f52e78 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:57.198094 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6dee4d41-0d7c-4884-a468-ee4e81f52e78 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:57.198869 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6dee4d41-0d7c-4884-a468-ee4e81f52e78 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:57.199303 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6dee4d41-0d7c-4884-a468-ee4e81f52e78 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:57.421431 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-6dee4d41-0d7c-4884-a468-ee4e81f52e78 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:57.429913 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-6dee4d41-0d7c-4884-a468-ee4e81f52e78 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1522 microversion: 2.1 time: 0.250465 May 03 21:29:57.430465 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 85/186] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:57 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:29:58.124297 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-ce842c3d-84cd-4323-82c1-13e258faacbf tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:58.125174 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-ce842c3d-84cd-4323-82c1-13e258faacbf tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 71fcec7c-c868-4296-b92d-704179c12e86] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:58.134795 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ce842c3d-84cd-4323-82c1-13e258faacbf tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:58.135357 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ce842c3d-84cd-4323-82c1-13e258faacbf tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:58.136253 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ce842c3d-84cd-4323-82c1-13e258faacbf tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:58.136874 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ce842c3d-84cd-4323-82c1-13e258faacbf tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:58.405732 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-ce842c3d-84cd-4323-82c1-13e258faacbf tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:58.420314 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-ce842c3d-84cd-4323-82c1-13e258faacbf tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86" status: 200 len: 1318 microversion: 2.1 time: 0.316748 May 03 21:29:58.420921 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 102/187] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:58 2022] GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86 => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:58.463773 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-21df33d4-04c9-4b91-b7c4-a60c4d34784e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:58.465163 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-21df33d4-04c9-4b91-b7c4-a60c4d34784e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:58.476576 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-21df33d4-04c9-4b91-b7c4-a60c4d34784e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:58.477280 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-21df33d4-04c9-4b91-b7c4-a60c4d34784e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:58.478289 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-21df33d4-04c9-4b91-b7c4-a60c4d34784e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:58.478911 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-21df33d4-04c9-4b91-b7c4-a60c4d34784e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:58.734143 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-21df33d4-04c9-4b91-b7c4-a60c4d34784e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:58.743037 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-21df33d4-04c9-4b91-b7c4-a60c4d34784e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1522 microversion: 2.1 time: 0.299288 May 03 21:29:58.743758 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 86/188] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:58 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:58.931380 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-0046f78f-e573-4a99-98e2-e93b7e14e4cf tempest-VolumesNegativeTest-1825826450 tempest-VolumesNegativeTest-1825826450-project] Action: 'create', calling method: .version_select at 0x7fc84cb3d5e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2031556634", "metadata": {"Type": "work"}}} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:29:58.933264 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-0046f78f-e573-4a99-98e2-e93b7e14e4cf tempest-VolumesNegativeTest-1825826450 tempest-VolumesNegativeTest-1825826450-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=97832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:29:58.934369 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-0046f78f-e573-4a99-98e2-e93b7e14e4cf tempest-VolumesNegativeTest-1825826450 tempest-VolumesNegativeTest-1825826450-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.340394 May 03 21:29:58.934968 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 103/189] 10.222.0.48 () {60 vars in 1155 bytes} [Tue May 3 21:29:58 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 342 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 03 21:29:58.950665 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-22f44d83-85ea-407a-85a6-dcba031f83ce tempest-VolumesNegativeTest-1825826450 tempest-VolumesNegativeTest-1825826450-project] Action: 'create', calling method: .version_select at 0x7fc84cd92040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-477962360", "metadata": {"Type": "work"}}} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:29:58.951988 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-22f44d83-85ea-407a-85a6-dcba031f83ce tempest-VolumesNegativeTest-1825826450 tempest-VolumesNegativeTest-1825826450-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=97831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:29:58.952994 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-22f44d83-85ea-407a-85a6-dcba031f83ce tempest-VolumesNegativeTest-1825826450 tempest-VolumesNegativeTest-1825826450-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012447 May 03 21:29:58.953876 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 87/190] 10.222.0.48 () {60 vars in 1155 bytes} [Tue May 3 21:29:58 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 03 21:29:58.969488 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-23db2f8a-ea2e-49e0-a80a-d6fdc71e7c1e tempest-VolumesNegativeTest-1825826450 tempest-VolumesNegativeTest-1825826450-project] Action: 'create', calling method: .version_select at 0x7fc84cc10d30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-993336192", "metadata": {"Type": "work"}}} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:29:58.971551 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-23db2f8a-ea2e-49e0-a80a-d6fdc71e7c1e tempest-VolumesNegativeTest-1825826450 tempest-VolumesNegativeTest-1825826450-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=97832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:29:58.972344 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-23db2f8a-ea2e-49e0-a80a-d6fdc71e7c1e tempest-VolumesNegativeTest-1825826450 tempest-VolumesNegativeTest-1825826450-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013178 May 03 21:29:58.972918 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 104/191] 10.222.0.48 () {60 vars in 1155 bytes} [Tue May 3 21:29:58 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 03 21:29:58.989611 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-8a45f46d-d19b-442f-a5e8-537b2c693f62 tempest-VolumesNegativeTest-1825826450 tempest-VolumesNegativeTest-1825826450-project] Calling method '.version_select at 0x7fc84ce5e670>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:59.057339 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.wsgi [None req-8a45f46d-d19b-442f-a5e8-537b2c693f62 tempest-VolumesNegativeTest-1825826450 tempest-VolumesNegativeTest-1825826450-project] HTTP exception thrown: Volume tempest-invalid-1714539783 could not be found. May 03 21:29:59.057951 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-8a45f46d-d19b-442f-a5e8-537b2c693f62 tempest-VolumesNegativeTest-1825826450 tempest-VolumesNegativeTest-1825826450-project] Returning 404 to user: Volume tempest-invalid-1714539783 could not be found. {{(pid=97831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:29:59.058828 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-8a45f46d-d19b-442f-a5e8-537b2c693f62 tempest-VolumesNegativeTest-1825826450 tempest-VolumesNegativeTest-1825826450-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1714539783" status: 404 len: 99 microversion: 2.1 time: 0.079113 May 03 21:29:59.060183 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 88/192] 10.222.0.48 () {58 vars in 1217 bytes} [Tue May 3 21:29:58 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1714539783 => generated 99 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 03 21:29:59.083164 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-005b6789-3ddd-4763-b5de-9067bdd556fd tempest-VolumesNegativeTest-1825826450 tempest-VolumesNegativeTest-1825826450-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009490 May 03 21:29:59.084031 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 105/193] 10.222.0.48 () {58 vars in 1139 bytes} [Tue May 3 21:29:59 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 03 21:29:59.112753 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-f263b12d-3e0b-4369-a852-fb85c88adc5d tempest-VolumesNegativeTest-1825826450 tempest-VolumesNegativeTest-1825826450-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.014850 May 03 21:29:59.113630 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 89/194] 10.222.0.48 () {58 vars in 1136 bytes} [Tue May 3 21:29:59 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 03 21:29:59.130082 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-ce7ceb67-92a8-4f1d-877b-6574dac9527f tempest-VolumesNegativeTest-1825826450 tempest-VolumesNegativeTest-1825826450-project] Calling method '.version_select at 0x7fc84ce48a60>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:59.198406 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.wsgi [None req-ce7ceb67-92a8-4f1d-877b-6574dac9527f tempest-VolumesNegativeTest-1825826450 tempest-VolumesNegativeTest-1825826450-project] HTTP exception thrown: Volume ce531ca1-c144-4ba1-b022-c6d02066245e could not be found. May 03 21:29:59.199123 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-ce7ceb67-92a8-4f1d-877b-6574dac9527f tempest-VolumesNegativeTest-1825826450 tempest-VolumesNegativeTest-1825826450-project] Returning 404 to user: Volume ce531ca1-c144-4ba1-b022-c6d02066245e could not be found. {{(pid=97832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:29:59.200077 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-ce7ceb67-92a8-4f1d-877b-6574dac9527f tempest-VolumesNegativeTest-1825826450 tempest-VolumesNegativeTest-1825826450-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/ce531ca1-c144-4ba1-b022-c6d02066245e" status: 404 len: 109 microversion: 2.1 time: 0.080531 May 03 21:29:59.200852 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 106/195] 10.222.0.48 () {58 vars in 1247 bytes} [Tue May 3 21:29:59 2022] DELETE /compute/v2.1/os-volumes/ce531ca1-c144-4ba1-b022-c6d02066245e => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 03 21:29:59.224902 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-9539be80-8abd-4e3b-aec0-d3076895dc97 tempest-VolumesNegativeTest-1825826450 tempest-VolumesNegativeTest-1825826450-project] Calling method '.version_select at 0x7fc84cd678b0>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:59.286119 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.wsgi [None req-9539be80-8abd-4e3b-aec0-d3076895dc97 tempest-VolumesNegativeTest-1825826450 tempest-VolumesNegativeTest-1825826450-project] HTTP exception thrown: Volume c3fccaba-0cb1-433b-8217-3dfe5149d246 could not be found. May 03 21:29:59.286735 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-9539be80-8abd-4e3b-aec0-d3076895dc97 tempest-VolumesNegativeTest-1825826450 tempest-VolumesNegativeTest-1825826450-project] Returning 404 to user: Volume c3fccaba-0cb1-433b-8217-3dfe5149d246 could not be found. {{(pid=97831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:29:59.287563 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-9539be80-8abd-4e3b-aec0-d3076895dc97 tempest-VolumesNegativeTest-1825826450 tempest-VolumesNegativeTest-1825826450-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/c3fccaba-0cb1-433b-8217-3dfe5149d246" status: 404 len: 109 microversion: 2.1 time: 0.080248 May 03 21:29:59.288106 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 90/196] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 3 21:29:59 2022] GET /compute/v2.1/os-volumes/c3fccaba-0cb1-433b-8217-3dfe5149d246 => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 21:29:59.452154 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-f80c63ee-bcf0-47c7-b89d-736ac1636e13 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:59.453885 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-f80c63ee-bcf0-47c7-b89d-736ac1636e13 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 71fcec7c-c868-4296-b92d-704179c12e86] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:59.462820 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f80c63ee-bcf0-47c7-b89d-736ac1636e13 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:59.463518 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f80c63ee-bcf0-47c7-b89d-736ac1636e13 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:59.464310 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f80c63ee-bcf0-47c7-b89d-736ac1636e13 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:59.464776 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f80c63ee-bcf0-47c7-b89d-736ac1636e13 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:59.732271 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-f80c63ee-bcf0-47c7-b89d-736ac1636e13 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:29:59.740514 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-f80c63ee-bcf0-47c7-b89d-736ac1636e13 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86" status: 200 len: 1318 microversion: 2.1 time: 0.298462 May 03 21:29:59.741054 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 107/197] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:59 2022] GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86 => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:29:59.771452 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-b8d07db0-fa5d-4979-99b4-2c23a34f9c94 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:29:59.772067 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-b8d07db0-fa5d-4979-99b4-2c23a34f9c94 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:29:59.780558 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b8d07db0-fa5d-4979-99b4-2c23a34f9c94 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:59.781008 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b8d07db0-fa5d-4979-99b4-2c23a34f9c94 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:29:59.781785 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b8d07db0-fa5d-4979-99b4-2c23a34f9c94 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:29:59.782226 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b8d07db0-fa5d-4979-99b4-2c23a34f9c94 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:00.015900 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-b8d07db0-fa5d-4979-99b4-2c23a34f9c94 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:00.034480 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-b8d07db0-fa5d-4979-99b4-2c23a34f9c94 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1522 microversion: 2.1 time: 0.275148 May 03 21:30:00.035288 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 91/198] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:29:59 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:30:00.394163 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-82c2d778-7ebc-4a51-9903-ae00ec12446f req-59e20baf-67f7-4faf-9c43-103d6c4751e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71fcec7c-c868-4296-b92d-704179c12e86", "name": "network-vif-plugged", "status": "completed", "tag": "846556a2-6669-4bf4-8f43-d938bc645197"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:30:00.403179 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:30:00.403179 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:30:00.412660 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-82c2d778-7ebc-4a51-9903-ae00ec12446f req-59e20baf-67f7-4faf-9c43-103d6c4751e0 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:00.413867 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-82c2d778-7ebc-4a51-9903-ae00ec12446f req-59e20baf-67f7-4faf-9c43-103d6c4751e0 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:00.438701 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-82c2d778-7ebc-4a51-9903-ae00ec12446f req-59e20baf-67f7-4faf-9c43-103d6c4751e0 service nova] Creating event network-vif-plugged:846556a2-6669-4bf4-8f43-d938bc645197 for instance 71fcec7c-c868-4296-b92d-704179c12e86 on hv-cinder-84037 May 03 21:30:00.443740 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-82c2d778-7ebc-4a51-9903-ae00ec12446f req-59e20baf-67f7-4faf-9c43-103d6c4751e0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060952 May 03 21:30:00.444370 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 108/199] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:30:00.768981 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-edeffb22-1ecf-41ec-855a-ebb733c91d03 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:00.768981 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-edeffb22-1ecf-41ec-855a-ebb733c91d03 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 71fcec7c-c868-4296-b92d-704179c12e86] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:00.773810 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-edeffb22-1ecf-41ec-855a-ebb733c91d03 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:00.773810 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-edeffb22-1ecf-41ec-855a-ebb733c91d03 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:00.774705 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-edeffb22-1ecf-41ec-855a-ebb733c91d03 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:00.775230 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-edeffb22-1ecf-41ec-855a-ebb733c91d03 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:01.057308 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-d43215c4-016d-4978-8f95-6aa0d60d1b03 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:01.058368 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-d43215c4-016d-4978-8f95-6aa0d60d1b03 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:01.067432 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d43215c4-016d-4978-8f95-6aa0d60d1b03 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:01.068277 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d43215c4-016d-4978-8f95-6aa0d60d1b03 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:01.069345 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d43215c4-016d-4978-8f95-6aa0d60d1b03 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:01.070049 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d43215c4-016d-4978-8f95-6aa0d60d1b03 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:01.126029 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-edeffb22-1ecf-41ec-855a-ebb733c91d03 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:01.140828 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-edeffb22-1ecf-41ec-855a-ebb733c91d03 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86" status: 200 len: 1318 microversion: 2.1 time: 0.386506 May 03 21:30:01.141846 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 92/200] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:00 2022] GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86 => generated 1318 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:30:01.326180 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-d43215c4-016d-4978-8f95-6aa0d60d1b03 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:01.334898 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-d43215c4-016d-4978-8f95-6aa0d60d1b03 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1522 microversion: 2.1 time: 0.287465 May 03 21:30:01.335436 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 109/201] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:01 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:30:02.165806 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-01b4bea8-c9d6-4987-ae1a-c4a3211a649c tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:02.167043 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-01b4bea8-c9d6-4987-ae1a-c4a3211a649c tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 71fcec7c-c868-4296-b92d-704179c12e86] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:02.178778 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-01b4bea8-c9d6-4987-ae1a-c4a3211a649c tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:02.180193 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-01b4bea8-c9d6-4987-ae1a-c4a3211a649c tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:02.181031 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-01b4bea8-c9d6-4987-ae1a-c4a3211a649c tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:02.197381 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-01b4bea8-c9d6-4987-ae1a-c4a3211a649c tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:02.364313 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-cd07b6bc-552f-4cd0-9d5f-a5552082657f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:02.365362 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-cd07b6bc-552f-4cd0-9d5f-a5552082657f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:02.409717 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cd07b6bc-552f-4cd0-9d5f-a5552082657f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:02.411977 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cd07b6bc-552f-4cd0-9d5f-a5552082657f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:02.411977 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cd07b6bc-552f-4cd0-9d5f-a5552082657f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:02.411977 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cd07b6bc-552f-4cd0-9d5f-a5552082657f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:02.478984 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-01b4bea8-c9d6-4987-ae1a-c4a3211a649c tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:02.497758 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-01b4bea8-c9d6-4987-ae1a-c4a3211a649c tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86" status: 200 len: 1318 microversion: 2.1 time: 0.342316 May 03 21:30:02.498794 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 93/202] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:02 2022] GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86 => generated 1318 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:30:02.755903 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-cd07b6bc-552f-4cd0-9d5f-a5552082657f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:02.766380 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-cd07b6bc-552f-4cd0-9d5f-a5552082657f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1522 microversion: 2.1 time: 0.416803 May 03 21:30:02.776091 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 110/203] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:02 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1522 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:30:03.520898 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-1d48f5b7-05e5-466d-a1e7-c531353a3562 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:03.521489 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-1d48f5b7-05e5-466d-a1e7-c531353a3562 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 71fcec7c-c868-4296-b92d-704179c12e86] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:03.529246 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1d48f5b7-05e5-466d-a1e7-c531353a3562 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:03.529704 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1d48f5b7-05e5-466d-a1e7-c531353a3562 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:03.530457 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1d48f5b7-05e5-466d-a1e7-c531353a3562 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:03.530889 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1d48f5b7-05e5-466d-a1e7-c531353a3562 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:03.789684 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-0e005c90-9e64-42c3-b2eb-8139f5272b47 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:03.791270 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-0e005c90-9e64-42c3-b2eb-8139f5272b47 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:03.800810 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0e005c90-9e64-42c3-b2eb-8139f5272b47 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:03.801336 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0e005c90-9e64-42c3-b2eb-8139f5272b47 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:03.802193 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0e005c90-9e64-42c3-b2eb-8139f5272b47 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:03.802700 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0e005c90-9e64-42c3-b2eb-8139f5272b47 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:03.894601 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-1d48f5b7-05e5-466d-a1e7-c531353a3562 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:03.903250 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-1d48f5b7-05e5-466d-a1e7-c531353a3562 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86" status: 200 len: 1508 microversion: 2.1 time: 0.392230 May 03 21:30:03.915626 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 94/204] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:03 2022] GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86 => generated 1508 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:30:04.027148 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-0e005c90-9e64-42c3-b2eb-8139f5272b47 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:04.036852 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-0e005c90-9e64-42c3-b2eb-8139f5272b47 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1522 microversion: 2.1 time: 0.256709 May 03 21:30:04.037221 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 111/205] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:03 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:30:05.060765 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-3b9781ad-856c-4a34-afc9-027233244dd7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:05.061382 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-3b9781ad-856c-4a34-afc9-027233244dd7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:05.068836 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-3b9781ad-856c-4a34-afc9-027233244dd7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:05.069552 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-3b9781ad-856c-4a34-afc9-027233244dd7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:05.070529 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-3b9781ad-856c-4a34-afc9-027233244dd7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:05.071333 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-3b9781ad-856c-4a34-afc9-027233244dd7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:05.285732 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-3b9781ad-856c-4a34-afc9-027233244dd7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:05.296799 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-3b9781ad-856c-4a34-afc9-027233244dd7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1522 microversion: 2.1 time: 0.245527 May 03 21:30:05.303995 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 95/206] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:05 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:30:06.320486 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-c85bfbbb-83cc-4625-a93e-e66f65ecb08e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:06.321144 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-c85bfbbb-83cc-4625-a93e-e66f65ecb08e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:06.329563 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c85bfbbb-83cc-4625-a93e-e66f65ecb08e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:06.330019 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c85bfbbb-83cc-4625-a93e-e66f65ecb08e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:06.330839 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c85bfbbb-83cc-4625-a93e-e66f65ecb08e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:06.331280 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c85bfbbb-83cc-4625-a93e-e66f65ecb08e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:06.554376 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-c85bfbbb-83cc-4625-a93e-e66f65ecb08e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:06.564300 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-c85bfbbb-83cc-4625-a93e-e66f65ecb08e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1522 microversion: 2.1 time: 0.253713 May 03 21:30:06.568502 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 112/207] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:06 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:30:07.588251 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-b45443d5-14a2-4287-94a8-7ab1341ab86f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:07.589494 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-b45443d5-14a2-4287-94a8-7ab1341ab86f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:07.597726 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b45443d5-14a2-4287-94a8-7ab1341ab86f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:07.598176 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b45443d5-14a2-4287-94a8-7ab1341ab86f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:07.598956 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b45443d5-14a2-4287-94a8-7ab1341ab86f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:07.599391 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b45443d5-14a2-4287-94a8-7ab1341ab86f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:07.964328 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-b45443d5-14a2-4287-94a8-7ab1341ab86f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:07.972944 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-b45443d5-14a2-4287-94a8-7ab1341ab86f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1522 microversion: 2.1 time: 0.394150 May 03 21:30:07.973742 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 96/208] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:07 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1522 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:30:08.997154 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-f33f76bd-4610-4769-bd6e-d688af0bbc96 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:08.997845 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-f33f76bd-4610-4769-bd6e-d688af0bbc96 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:09.005418 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f33f76bd-4610-4769-bd6e-d688af0bbc96 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:09.005864 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f33f76bd-4610-4769-bd6e-d688af0bbc96 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:09.006661 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f33f76bd-4610-4769-bd6e-d688af0bbc96 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:09.007180 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f33f76bd-4610-4769-bd6e-d688af0bbc96 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:09.245562 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-f33f76bd-4610-4769-bd6e-d688af0bbc96 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:09.254932 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-f33f76bd-4610-4769-bd6e-d688af0bbc96 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1522 microversion: 2.1 time: 0.268118 May 03 21:30:09.255405 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 113/209] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:08 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:30:10.281445 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-5c4edab6-8648-4838-a837-b36e0095a508 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:10.282057 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-5c4edab6-8648-4838-a837-b36e0095a508 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:10.289362 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5c4edab6-8648-4838-a837-b36e0095a508 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:10.289808 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5c4edab6-8648-4838-a837-b36e0095a508 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:10.290580 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5c4edab6-8648-4838-a837-b36e0095a508 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:10.291010 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5c4edab6-8648-4838-a837-b36e0095a508 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:10.511017 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-5c4edab6-8648-4838-a837-b36e0095a508 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:10.520035 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-5c4edab6-8648-4838-a837-b36e0095a508 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1522 microversion: 2.1 time: 0.252888 May 03 21:30:10.520613 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 97/210] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:10 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:30:11.544661 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-283dae76-7f09-4a07-b31a-6313bfc04444 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:11.545281 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-283dae76-7f09-4a07-b31a-6313bfc04444 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:11.552918 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-283dae76-7f09-4a07-b31a-6313bfc04444 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:11.553372 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-283dae76-7f09-4a07-b31a-6313bfc04444 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:11.554149 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-283dae76-7f09-4a07-b31a-6313bfc04444 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:11.558896 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-283dae76-7f09-4a07-b31a-6313bfc04444 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:11.771641 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-283dae76-7f09-4a07-b31a-6313bfc04444 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:11.781926 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-283dae76-7f09-4a07-b31a-6313bfc04444 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1522 microversion: 2.1 time: 0.247302 May 03 21:30:11.782482 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 114/211] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:11 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:30:12.810591 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-d0eab82c-727c-4fa2-a869-53929fa10936 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:12.812314 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-d0eab82c-727c-4fa2-a869-53929fa10936 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:12.821843 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d0eab82c-727c-4fa2-a869-53929fa10936 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:12.822290 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d0eab82c-727c-4fa2-a869-53929fa10936 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:12.823260 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d0eab82c-727c-4fa2-a869-53929fa10936 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:12.823723 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d0eab82c-727c-4fa2-a869-53929fa10936 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:13.043864 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-d0eab82c-727c-4fa2-a869-53929fa10936 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:13.052194 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-d0eab82c-727c-4fa2-a869-53929fa10936 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1502 microversion: 2.1 time: 0.256237 May 03 21:30:13.053284 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 98/212] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:12 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1502 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:30:13.083717 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-e3f697fd-0719-46d1-9be3-355c553b7567 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:13.086731 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-e3f697fd-0719-46d1-9be3-355c553b7567 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:13.113229 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e3f697fd-0719-46d1-9be3-355c553b7567 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:13.113733 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e3f697fd-0719-46d1-9be3-355c553b7567 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:13.114690 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e3f697fd-0719-46d1-9be3-355c553b7567 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:13.118812 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e3f697fd-0719-46d1-9be3-355c553b7567 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:13.468747 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-e3f697fd-0719-46d1-9be3-355c553b7567 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:13.478562 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-e3f697fd-0719-46d1-9be3-355c553b7567 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9" status: 200 len: 1516 microversion: 2.1 time: 0.410482 May 03 21:30:13.492080 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 115/213] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:13 2022] GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9 => generated 1516 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:30:19.088084 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-d157d2df-794b-416f-a4ad-95c79d9f81a4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:30:19.090695 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-d157d2df-794b-416f-a4ad-95c79d9f81a4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:19.099008 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d157d2df-794b-416f-a4ad-95c79d9f81a4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:19.099694 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d157d2df-794b-416f-a4ad-95c79d9f81a4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:19.100684 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d157d2df-794b-416f-a4ad-95c79d9f81a4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:19.101125 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d157d2df-794b-416f-a4ad-95c79d9f81a4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:19.201272 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.objects.instance [None req-d157d2df-794b-416f-a4ad-95c79d9f81a4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lazy-loading 'flavor' on Instance uuid dffdb65a-4c55-4f89-afd3-ff88a82805d9 {{(pid=97831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 03 21:30:19.923762 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-d157d2df-794b-416f-a4ad-95c79d9f81a4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "POST /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9/action" status: 200 len: 32 microversion: 2.1 time: 0.846641 May 03 21:30:19.928965 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 99/214] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 3 21:30:19 2022] POST /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9/action => generated 32 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 03 21:30:19.946727 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-30d06a7a-6b2a-48e0-a68a-b3eb6bdf6329 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:19.947445 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-30d06a7a-6b2a-48e0-a68a-b3eb6bdf6329 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:19.956247 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-30d06a7a-6b2a-48e0-a68a-b3eb6bdf6329 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:19.956768 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-30d06a7a-6b2a-48e0-a68a-b3eb6bdf6329 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:19.957491 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-30d06a7a-6b2a-48e0-a68a-b3eb6bdf6329 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:19.957920 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-30d06a7a-6b2a-48e0-a68a-b3eb6bdf6329 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:20.288931 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-30d06a7a-6b2a-48e0-a68a-b3eb6bdf6329 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:20.310707 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-30d06a7a-6b2a-48e0-a68a-b3eb6bdf6329 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9" status: 200 len: 1522 microversion: 2.1 time: 0.362613 May 03 21:30:20.310707 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 116/215] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:19 2022] GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9 => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:30:21.322966 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-7d8e53a9-89f6-491f-ad0e-7e56e3922fe1 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:21.323786 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-7d8e53a9-89f6-491f-ad0e-7e56e3922fe1 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:21.332548 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7d8e53a9-89f6-491f-ad0e-7e56e3922fe1 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:21.332997 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7d8e53a9-89f6-491f-ad0e-7e56e3922fe1 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:21.333926 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7d8e53a9-89f6-491f-ad0e-7e56e3922fe1 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:21.334382 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7d8e53a9-89f6-491f-ad0e-7e56e3922fe1 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:21.828939 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-7d8e53a9-89f6-491f-ad0e-7e56e3922fe1 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:21.837479 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-7d8e53a9-89f6-491f-ad0e-7e56e3922fe1 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9" status: 200 len: 1522 microversion: 2.1 time: 0.524084 May 03 21:30:21.838029 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 100/216] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:21 2022] GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9 => generated 1522 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:30:22.860044 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-5c732b4a-1b2e-4200-884a-b2cb753cd7d3 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:22.860689 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-5c732b4a-1b2e-4200-884a-b2cb753cd7d3 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:22.868929 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5c732b4a-1b2e-4200-884a-b2cb753cd7d3 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:22.874177 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5c732b4a-1b2e-4200-884a-b2cb753cd7d3 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:22.874177 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5c732b4a-1b2e-4200-884a-b2cb753cd7d3 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:22.874177 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5c732b4a-1b2e-4200-884a-b2cb753cd7d3 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:23.108186 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-5c732b4a-1b2e-4200-884a-b2cb753cd7d3 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:23.116768 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-5c732b4a-1b2e-4200-884a-b2cb753cd7d3 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9" status: 200 len: 1522 microversion: 2.1 time: 0.265995 May 03 21:30:23.117399 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 117/217] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:22 2022] GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9 => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:30:24.141038 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-42a2a9d6-5692-4118-b6ad-a0c80c14c28b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:24.142157 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-42a2a9d6-5692-4118-b6ad-a0c80c14c28b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:24.149336 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-42a2a9d6-5692-4118-b6ad-a0c80c14c28b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:24.149783 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-42a2a9d6-5692-4118-b6ad-a0c80c14c28b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:24.150553 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-42a2a9d6-5692-4118-b6ad-a0c80c14c28b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:24.150985 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-42a2a9d6-5692-4118-b6ad-a0c80c14c28b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:24.381517 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-42a2a9d6-5692-4118-b6ad-a0c80c14c28b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:24.392536 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-42a2a9d6-5692-4118-b6ad-a0c80c14c28b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9" status: 200 len: 1522 microversion: 2.1 time: 0.260525 May 03 21:30:24.393292 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 101/218] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:24 2022] GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:30:25.419424 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-d31ecf8c-fd1d-47e6-baf6-a5a218b3b1b0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:25.420092 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-d31ecf8c-fd1d-47e6-baf6-a5a218b3b1b0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:25.428682 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d31ecf8c-fd1d-47e6-baf6-a5a218b3b1b0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:25.429130 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d31ecf8c-fd1d-47e6-baf6-a5a218b3b1b0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:25.429897 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d31ecf8c-fd1d-47e6-baf6-a5a218b3b1b0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:25.430329 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d31ecf8c-fd1d-47e6-baf6-a5a218b3b1b0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:25.650010 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-d31ecf8c-fd1d-47e6-baf6-a5a218b3b1b0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:25.658988 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-d31ecf8c-fd1d-47e6-baf6-a5a218b3b1b0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9" status: 200 len: 1522 microversion: 2.1 time: 0.249333 May 03 21:30:25.659536 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 118/219] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:25 2022] GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:30:26.683002 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-a5dc7717-1d4a-41dd-ba26-a63ac0687bcc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:26.683725 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-a5dc7717-1d4a-41dd-ba26-a63ac0687bcc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:26.691774 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a5dc7717-1d4a-41dd-ba26-a63ac0687bcc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:26.692338 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a5dc7717-1d4a-41dd-ba26-a63ac0687bcc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:26.693229 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a5dc7717-1d4a-41dd-ba26-a63ac0687bcc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:26.693634 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a5dc7717-1d4a-41dd-ba26-a63ac0687bcc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:26.938117 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-a5dc7717-1d4a-41dd-ba26-a63ac0687bcc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:26.949328 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-a5dc7717-1d4a-41dd-ba26-a63ac0687bcc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9" status: 200 len: 1522 microversion: 2.1 time: 0.274608 May 03 21:30:26.949891 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 102/220] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:26 2022] GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:30:27.971511 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-d24b38f8-3e5e-433f-9c49-da70c8667cac tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:27.972205 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-d24b38f8-3e5e-433f-9c49-da70c8667cac tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:27.980303 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d24b38f8-3e5e-433f-9c49-da70c8667cac tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:27.981120 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d24b38f8-3e5e-433f-9c49-da70c8667cac tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:27.982002 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d24b38f8-3e5e-433f-9c49-da70c8667cac tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:27.982510 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d24b38f8-3e5e-433f-9c49-da70c8667cac tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:28.239500 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-d24b38f8-3e5e-433f-9c49-da70c8667cac tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:28.248240 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-d24b38f8-3e5e-433f-9c49-da70c8667cac tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9" status: 200 len: 1522 microversion: 2.1 time: 0.286229 May 03 21:30:28.248829 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 119/221] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:27 2022] GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9 => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:30:29.271190 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-aeb088d4-bafe-4c36-a248-e111e6ddde3b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:29.271828 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-aeb088d4-bafe-4c36-a248-e111e6ddde3b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:29.279987 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-aeb088d4-bafe-4c36-a248-e111e6ddde3b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:29.280471 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-aeb088d4-bafe-4c36-a248-e111e6ddde3b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:29.281233 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-aeb088d4-bafe-4c36-a248-e111e6ddde3b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:29.281659 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-aeb088d4-bafe-4c36-a248-e111e6ddde3b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:29.504265 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-aeb088d4-bafe-4c36-a248-e111e6ddde3b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:29.513131 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-aeb088d4-bafe-4c36-a248-e111e6ddde3b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9" status: 200 len: 1522 microversion: 2.1 time: 0.252666 May 03 21:30:29.513663 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 103/222] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:29 2022] GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9 => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:30:30.535840 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-37aa992c-a399-458d-9062-64dc325aa0a7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:30.536490 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-37aa992c-a399-458d-9062-64dc325aa0a7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:30.544383 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-37aa992c-a399-458d-9062-64dc325aa0a7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:30.544859 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-37aa992c-a399-458d-9062-64dc325aa0a7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:30.546425 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-37aa992c-a399-458d-9062-64dc325aa0a7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:30.546856 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-37aa992c-a399-458d-9062-64dc325aa0a7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:30.754141 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-37aa992c-a399-458d-9062-64dc325aa0a7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:30.762417 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-37aa992c-a399-458d-9062-64dc325aa0a7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9" status: 200 len: 1522 microversion: 2.1 time: 0.236350 May 03 21:30:30.764726 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 120/223] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:30 2022] GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:30:31.786126 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-c943dbd0-b783-4f46-8e94-02295290dd15 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:31.786728 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-c943dbd0-b783-4f46-8e94-02295290dd15 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:31.794325 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c943dbd0-b783-4f46-8e94-02295290dd15 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:31.794770 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c943dbd0-b783-4f46-8e94-02295290dd15 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:31.795532 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c943dbd0-b783-4f46-8e94-02295290dd15 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:31.795960 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c943dbd0-b783-4f46-8e94-02295290dd15 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:32.013350 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-c943dbd0-b783-4f46-8e94-02295290dd15 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:32.021832 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-c943dbd0-b783-4f46-8e94-02295290dd15 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9" status: 200 len: 1522 microversion: 2.1 time: 0.246032 May 03 21:30:32.022491 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 104/224] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:31 2022] GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:30:33.044944 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-97cc5dd2-f6ce-458c-b4c2-20d75826b8d6 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:33.045565 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-97cc5dd2-f6ce-458c-b4c2-20d75826b8d6 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:33.052966 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-97cc5dd2-f6ce-458c-b4c2-20d75826b8d6 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:33.059669 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-97cc5dd2-f6ce-458c-b4c2-20d75826b8d6 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:33.059669 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-97cc5dd2-f6ce-458c-b4c2-20d75826b8d6 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:33.059669 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-97cc5dd2-f6ce-458c-b4c2-20d75826b8d6 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:33.263611 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-97cc5dd2-f6ce-458c-b4c2-20d75826b8d6 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:33.272115 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-97cc5dd2-f6ce-458c-b4c2-20d75826b8d6 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9" status: 200 len: 1522 microversion: 2.1 time: 0.237217 May 03 21:30:33.272853 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 121/225] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:33 2022] GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:30:34.296506 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-d0f45f3b-516d-4e33-8596-02566d63ebcd tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:34.308138 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-d0f45f3b-516d-4e33-8596-02566d63ebcd tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:34.308138 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d0f45f3b-516d-4e33-8596-02566d63ebcd tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:34.308138 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d0f45f3b-516d-4e33-8596-02566d63ebcd tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:34.308138 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d0f45f3b-516d-4e33-8596-02566d63ebcd tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:34.308585 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d0f45f3b-516d-4e33-8596-02566d63ebcd tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:34.507846 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-d0f45f3b-516d-4e33-8596-02566d63ebcd tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:34.517042 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-d0f45f3b-516d-4e33-8596-02566d63ebcd tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9" status: 200 len: 1522 microversion: 2.1 time: 0.230201 May 03 21:30:34.517572 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 105/226] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:34 2022] GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:30:35.539537 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-83ac84ed-d5b3-4320-84ae-0c7cf256df66 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:35.540131 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-83ac84ed-d5b3-4320-84ae-0c7cf256df66 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:35.548028 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-83ac84ed-d5b3-4320-84ae-0c7cf256df66 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:35.548511 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-83ac84ed-d5b3-4320-84ae-0c7cf256df66 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:35.549262 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-83ac84ed-d5b3-4320-84ae-0c7cf256df66 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:35.549686 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-83ac84ed-d5b3-4320-84ae-0c7cf256df66 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:35.753983 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-83ac84ed-d5b3-4320-84ae-0c7cf256df66 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:35.762998 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-83ac84ed-d5b3-4320-84ae-0c7cf256df66 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9" status: 200 len: 1522 microversion: 2.1 time: 0.232422 May 03 21:30:35.763771 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 122/227] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:35 2022] GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:30:36.785185 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-91a4d800-4b00-4701-b816-1ad60d7b55fb tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:36.785782 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-91a4d800-4b00-4701-b816-1ad60d7b55fb tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:36.794023 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-91a4d800-4b00-4701-b816-1ad60d7b55fb tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:36.794383 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-91a4d800-4b00-4701-b816-1ad60d7b55fb tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:36.795177 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-91a4d800-4b00-4701-b816-1ad60d7b55fb tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:36.795592 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-91a4d800-4b00-4701-b816-1ad60d7b55fb tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:36.913478 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-92f89dca-578e-4812-a28d-62b8f82fd0f4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:36.914037 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-92f89dca-578e-4812-a28d-62b8f82fd0f4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:36.922560 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-92f89dca-578e-4812-a28d-62b8f82fd0f4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:36.923288 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-92f89dca-578e-4812-a28d-62b8f82fd0f4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:36.924245 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-92f89dca-578e-4812-a28d-62b8f82fd0f4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:36.925371 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-92f89dca-578e-4812-a28d-62b8f82fd0f4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:36.995635 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-92f89dca-578e-4812-a28d-62b8f82fd0f4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14/ips" status: 200 len: 150 microversion: 2.1 time: 0.090363 May 03 21:30:36.996452 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 123/228] 10.222.0.48 () {58 vars in 1247 bytes} [Tue May 3 21:30:36 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14/ips => generated 150 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:30:37.039991 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-91a4d800-4b00-4701-b816-1ad60d7b55fb tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:37.048643 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-91a4d800-4b00-4701-b816-1ad60d7b55fb tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9" status: 200 len: 1522 microversion: 2.1 time: 0.272686 May 03 21:30:37.049178 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 106/229] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:36 2022] GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:30:38.073936 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-3c7391fd-7009-4298-9909-0f19e6d89813 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:38.073936 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-3c7391fd-7009-4298-9909-0f19e6d89813 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:38.081849 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3c7391fd-7009-4298-9909-0f19e6d89813 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:38.082498 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3c7391fd-7009-4298-9909-0f19e6d89813 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:38.083272 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3c7391fd-7009-4298-9909-0f19e6d89813 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:38.083736 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3c7391fd-7009-4298-9909-0f19e6d89813 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:38.309983 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-3c7391fd-7009-4298-9909-0f19e6d89813 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:38.318102 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-3c7391fd-7009-4298-9909-0f19e6d89813 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9" status: 200 len: 1522 microversion: 2.1 time: 0.257095 May 03 21:30:38.318650 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 124/230] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:38 2022] GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:30:39.344160 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-fb71dc4c-c14c-481d-94a2-ca2cf373f7b5 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:39.345372 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-fb71dc4c-c14c-481d-94a2-ca2cf373f7b5 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:39.354191 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fb71dc4c-c14c-481d-94a2-ca2cf373f7b5 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:39.354975 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fb71dc4c-c14c-481d-94a2-ca2cf373f7b5 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:39.356243 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fb71dc4c-c14c-481d-94a2-ca2cf373f7b5 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:39.356775 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fb71dc4c-c14c-481d-94a2-ca2cf373f7b5 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:39.576680 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-fb71dc4c-c14c-481d-94a2-ca2cf373f7b5 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:39.584786 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-fb71dc4c-c14c-481d-94a2-ca2cf373f7b5 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9" status: 200 len: 1522 microversion: 2.1 time: 0.252327 May 03 21:30:39.585322 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 107/231] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:39 2022] GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9 => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:30:40.289681 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-f5fabfd8-c8c6-4e78-99fa-892ca5e3fb1b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34c9d45b-c408-4504-a3cf-4787c0878669"}} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:30:40.290826 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-f5fabfd8-c8c6-4e78-99fa-892ca5e3fb1b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:40.298752 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f5fabfd8-c8c6-4e78-99fa-892ca5e3fb1b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:40.299196 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f5fabfd8-c8c6-4e78-99fa-892ca5e3fb1b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:40.299968 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f5fabfd8-c8c6-4e78-99fa-892ca5e3fb1b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:40.300410 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f5fabfd8-c8c6-4e78-99fa-892ca5e3fb1b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:40.607754 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-b5300456-55b5-41aa-9937-bde70df0ef14 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:40.608392 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-b5300456-55b5-41aa-9937-bde70df0ef14 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:40.615660 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b5300456-55b5-41aa-9937-bde70df0ef14 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:40.617687 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b5300456-55b5-41aa-9937-bde70df0ef14 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:40.617687 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b5300456-55b5-41aa-9937-bde70df0ef14 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:40.617687 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b5300456-55b5-41aa-9937-bde70df0ef14 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:40.832082 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-b5300456-55b5-41aa-9937-bde70df0ef14 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:40.840185 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-b5300456-55b5-41aa-9937-bde70df0ef14 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9" status: 200 len: 1522 microversion: 2.1 time: 0.242339 May 03 21:30:40.840745 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 108/232] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:40 2022] GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:30:41.491516 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-b2ce2fb6-58f9-41fe-8558-20a42a5b978a tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:41.492005 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-b2ce2fb6-58f9-41fe-8558-20a42a5b978a tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:41.499613 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b2ce2fb6-58f9-41fe-8558-20a42a5b978a tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:41.500057 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b2ce2fb6-58f9-41fe-8558-20a42a5b978a tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:41.500857 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b2ce2fb6-58f9-41fe-8558-20a42a5b978a tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:41.501286 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b2ce2fb6-58f9-41fe-8558-20a42a5b978a tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:41.567273 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-b2ce2fb6-58f9-41fe-8558-20a42a5b978a tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a/ips" status: 200 len: 145 microversion: 2.1 time: 0.084928 May 03 21:30:41.567836 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 109/233] 10.222.0.48 () {58 vars in 1247 bytes} [Tue May 3 21:30:41 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a/ips => generated 145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:30:41.862623 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-7145a37f-49ad-45d2-a124-99b18c5691da tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:41.863262 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-7145a37f-49ad-45d2-a124-99b18c5691da tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:41.871246 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7145a37f-49ad-45d2-a124-99b18c5691da tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:41.871688 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7145a37f-49ad-45d2-a124-99b18c5691da tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:41.872464 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7145a37f-49ad-45d2-a124-99b18c5691da tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:41.872897 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7145a37f-49ad-45d2-a124-99b18c5691da tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:42.081206 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-7145a37f-49ad-45d2-a124-99b18c5691da tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:42.089513 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-7145a37f-49ad-45d2-a124-99b18c5691da tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9" status: 200 len: 1522 microversion: 2.1 time: 0.236345 May 03 21:30:42.090040 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 110/234] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:41 2022] GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:30:43.114609 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-a2287ec0-366b-4a98-9e33-8d2f11440935 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:43.115952 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-a2287ec0-366b-4a98-9e33-8d2f11440935 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:43.125208 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a2287ec0-366b-4a98-9e33-8d2f11440935 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:43.125668 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a2287ec0-366b-4a98-9e33-8d2f11440935 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:43.126454 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a2287ec0-366b-4a98-9e33-8d2f11440935 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:43.126890 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a2287ec0-366b-4a98-9e33-8d2f11440935 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:43.342162 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-f5fabfd8-c8c6-4e78-99fa-892ca5e3fb1b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "POST /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.061433 May 03 21:30:43.342823 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 125/235] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 3 21:30:40 2022] POST /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14/os-volume_attachments => generated 194 bytes in 3063 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:30:43.356909 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-a2287ec0-366b-4a98-9e33-8d2f11440935 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:43.367293 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-a2287ec0-366b-4a98-9e33-8d2f11440935 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9" status: 200 len: 1522 microversion: 2.1 time: 0.263901 May 03 21:30:43.367832 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 111/236] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:43 2022] GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:30:44.391980 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-76abeba8-00ac-4ee8-89d5-7d237a87f05a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:44.392702 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-76abeba8-00ac-4ee8-89d5-7d237a87f05a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:44.402777 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-76abeba8-00ac-4ee8-89d5-7d237a87f05a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:44.403219 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-76abeba8-00ac-4ee8-89d5-7d237a87f05a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:44.403979 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-76abeba8-00ac-4ee8-89d5-7d237a87f05a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:44.404403 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-76abeba8-00ac-4ee8-89d5-7d237a87f05a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:44.625838 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-76abeba8-00ac-4ee8-89d5-7d237a87f05a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:44.634264 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-76abeba8-00ac-4ee8-89d5-7d237a87f05a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9" status: 200 len: 1522 microversion: 2.1 time: 0.253083 May 03 21:30:44.641400 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 126/237] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:44 2022] GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:30:44.997148 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-e5ada38c-6b3b-4909-93dd-a8024aa1e930 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a3a50dc-a809-4136-9d23-292a72887d4f"}} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:30:44.998263 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-e5ada38c-6b3b-4909-93dd-a8024aa1e930 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:45.006345 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e5ada38c-6b3b-4909-93dd-a8024aa1e930 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:45.007105 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e5ada38c-6b3b-4909-93dd-a8024aa1e930 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:45.008037 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e5ada38c-6b3b-4909-93dd-a8024aa1e930 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:45.008665 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e5ada38c-6b3b-4909-93dd-a8024aa1e930 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:45.672090 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-67a51af2-d1ea-4a3e-a975-5f60ee8fbb5c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:45.673913 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-67a51af2-d1ea-4a3e-a975-5f60ee8fbb5c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:45.687569 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-67a51af2-d1ea-4a3e-a975-5f60ee8fbb5c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:45.688615 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-67a51af2-d1ea-4a3e-a975-5f60ee8fbb5c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:45.689992 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-67a51af2-d1ea-4a3e-a975-5f60ee8fbb5c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:45.690714 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-67a51af2-d1ea-4a3e-a975-5f60ee8fbb5c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:46.095754 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-67a51af2-d1ea-4a3e-a975-5f60ee8fbb5c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:46.112289 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-67a51af2-d1ea-4a3e-a975-5f60ee8fbb5c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9" status: 200 len: 1522 microversion: 2.1 time: 0.457435 May 03 21:30:46.113500 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 127/238] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:45 2022] GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9 => generated 1522 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:30:46.148962 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-422efa6d-f190-4236-965b-9b37d46f35df tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a4c6d09-f23b-4ed9-bd6f-8c30fb7bf856", "device": "/dev/sdb"}} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:30:46.154269 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-422efa6d-f190-4236-965b-9b37d46f35df tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 71fcec7c-c868-4296-b92d-704179c12e86] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:46.168722 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-422efa6d-f190-4236-965b-9b37d46f35df tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:46.169676 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-422efa6d-f190-4236-965b-9b37d46f35df tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:46.171935 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-422efa6d-f190-4236-965b-9b37d46f35df tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:46.172972 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-422efa6d-f190-4236-965b-9b37d46f35df tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:46.684268 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-e5ada38c-6b3b-4909-93dd-a8024aa1e930 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "POST /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.697245 May 03 21:30:46.684930 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 112/239] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 3 21:30:44 2022] POST /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a/os-volume_attachments => generated 194 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:30:47.148007 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-22a5bf65-891e-4503-bb92-5c6241d00e9b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:47.148745 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-22a5bf65-891e-4503-bb92-5c6241d00e9b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:47.157786 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-22a5bf65-891e-4503-bb92-5c6241d00e9b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:47.158665 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-22a5bf65-891e-4503-bb92-5c6241d00e9b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:47.159074 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-22a5bf65-891e-4503-bb92-5c6241d00e9b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:47.159551 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-22a5bf65-891e-4503-bb92-5c6241d00e9b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:47.481492 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-22a5bf65-891e-4503-bb92-5c6241d00e9b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:47.496575 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-422efa6d-f190-4236-965b-9b37d46f35df tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "POST /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.380425 May 03 21:30:47.497613 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 128/240] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 3 21:30:46 2022] POST /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86/os-volume_attachments => generated 194 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:30:47.499623 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-22a5bf65-891e-4503-bb92-5c6241d00e9b tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9" status: 200 len: 1502 microversion: 2.1 time: 0.364296 May 03 21:30:47.500174 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 113/241] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:47 2022] GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9 => generated 1502 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:30:47.523465 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-488d2e04-1662-4ee8-8320-a617db4b8ce9 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db0e8558-574c-4158-b90c-8d80771d9f7b"}} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:30:47.524996 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-488d2e04-1662-4ee8-8320-a617db4b8ce9 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:47.535222 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-488d2e04-1662-4ee8-8320-a617db4b8ce9 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:47.535915 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-488d2e04-1662-4ee8-8320-a617db4b8ce9 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:47.537111 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-488d2e04-1662-4ee8-8320-a617db4b8ce9 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:47.537546 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-488d2e04-1662-4ee8-8320-a617db4b8ce9 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:47.631831 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.wsgi [None req-488d2e04-1662-4ee8-8320-a617db4b8ce9 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] HTTP exception thrown: Cannot 'attach_volume' instance dffdb65a-4c55-4f89-afd3-ff88a82805d9 while it is in vm_state rescued May 03 21:30:47.632575 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-488d2e04-1662-4ee8-8320-a617db4b8ce9 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Returning 409 to user: Cannot 'attach_volume' instance dffdb65a-4c55-4f89-afd3-ff88a82805d9 while it is in vm_state rescued {{(pid=97832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:30:47.633709 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-488d2e04-1662-4ee8-8320-a617db4b8ce9 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "POST /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.120809 May 03 21:30:47.634799 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 129/242] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 3 21:30:47 2022] POST /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9/os-volume_attachments => generated 152 bytes in 123 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 03 21:30:47.649923 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-073eadf6-0e28-4e53-b9df-0f5882649439 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:30:47.650476 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-073eadf6-0e28-4e53-b9df-0f5882649439 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:47.658858 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-073eadf6-0e28-4e53-b9df-0f5882649439 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:47.659556 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-073eadf6-0e28-4e53-b9df-0f5882649439 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:47.660584 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-073eadf6-0e28-4e53-b9df-0f5882649439 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:47.661175 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-073eadf6-0e28-4e53-b9df-0f5882649439 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:48.073526 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-073eadf6-0e28-4e53-b9df-0f5882649439 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "POST /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9/action" status: 202 len: 0 microversion: 2.1 time: 0.432393 May 03 21:30:48.074235 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 114/243] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 3 21:30:47 2022] POST /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9/action => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 21:30:48.090694 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-b66296f9-10c1-4ee3-b7b9-cbd4f2eb6577 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:48.091327 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-b66296f9-10c1-4ee3-b7b9-cbd4f2eb6577 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:48.100341 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b66296f9-10c1-4ee3-b7b9-cbd4f2eb6577 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:48.100978 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b66296f9-10c1-4ee3-b7b9-cbd4f2eb6577 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:48.101964 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b66296f9-10c1-4ee3-b7b9-cbd4f2eb6577 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:48.102610 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b66296f9-10c1-4ee3-b7b9-cbd4f2eb6577 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:48.339634 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-b66296f9-10c1-4ee3-b7b9-cbd4f2eb6577 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:48.348514 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-b66296f9-10c1-4ee3-b7b9-cbd4f2eb6577 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9" status: 200 len: 1510 microversion: 2.1 time: 0.269495 May 03 21:30:48.349190 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 130/244] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:48 2022] GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9 => generated 1510 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:30:49.374700 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-71bd691d-4f3e-4df8-bacf-b34dd0b28d54 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:49.375377 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-71bd691d-4f3e-4df8-bacf-b34dd0b28d54 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:49.382933 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-71bd691d-4f3e-4df8-bacf-b34dd0b28d54 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:49.383385 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-71bd691d-4f3e-4df8-bacf-b34dd0b28d54 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:49.384159 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-71bd691d-4f3e-4df8-bacf-b34dd0b28d54 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:49.384618 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-71bd691d-4f3e-4df8-bacf-b34dd0b28d54 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:49.621779 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-71bd691d-4f3e-4df8-bacf-b34dd0b28d54 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:49.630928 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-71bd691d-4f3e-4df8-bacf-b34dd0b28d54 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9" status: 200 len: 1510 microversion: 2.1 time: 0.267326 May 03 21:30:49.631488 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 115/245] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:49 2022] GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9 => generated 1510 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:30:50.655143 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-5026ee01-9d45-4f1a-9498-22ed245feb0c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:50.656169 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-5026ee01-9d45-4f1a-9498-22ed245feb0c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:50.664357 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5026ee01-9d45-4f1a-9498-22ed245feb0c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:50.664838 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5026ee01-9d45-4f1a-9498-22ed245feb0c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:50.665616 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5026ee01-9d45-4f1a-9498-22ed245feb0c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:50.666697 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5026ee01-9d45-4f1a-9498-22ed245feb0c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:50.957176 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-5026ee01-9d45-4f1a-9498-22ed245feb0c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:50.967126 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-5026ee01-9d45-4f1a-9498-22ed245feb0c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9" status: 200 len: 1510 microversion: 2.1 time: 0.322388 May 03 21:30:50.967682 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 131/246] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:50 2022] GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9 => generated 1510 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:30:51.991132 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-39400c58-a2c4-44db-9bdc-380bfc6ddc51 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:51.991866 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-39400c58-a2c4-44db-9bdc-380bfc6ddc51 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:51.999572 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-39400c58-a2c4-44db-9bdc-380bfc6ddc51 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:52.000352 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-39400c58-a2c4-44db-9bdc-380bfc6ddc51 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:52.001425 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-39400c58-a2c4-44db-9bdc-380bfc6ddc51 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:52.001938 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-39400c58-a2c4-44db-9bdc-380bfc6ddc51 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:52.250970 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-39400c58-a2c4-44db-9bdc-380bfc6ddc51 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:52.278622 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-39400c58-a2c4-44db-9bdc-380bfc6ddc51 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9" status: 200 len: 1516 microversion: 2.1 time: 0.296842 May 03 21:30:52.281469 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 116/247] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:51 2022] GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9 => generated 1516 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:30:54.300789 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-883bc4c0-71e4-4999-bc1d-948b83df21be tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Action: 'create', calling method: .version_select at 0x7fc84cb3dc10>, body: {"keypair": {"name": "tempest-keypair-2139605624"}} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:30:54.329194 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-883bc4c0-71e4-4999-bc1d-948b83df21be tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Getting quotas for project bd571e41b44a4bc6b16bf8163252f168. Resources: {'key_pairs'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:30:54.333071 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-883bc4c0-71e4-4999-bc1d-948b83df21be tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Getting quotas for user c2fe2da4d72e4522ac8bbb7c9a58381a and project bd571e41b44a4bc6b16bf8163252f168. Resources: {'key_pairs'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:30:54.589686 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-883bc4c0-71e4-4999-bc1d-948b83df21be tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Getting quotas for project bd571e41b44a4bc6b16bf8163252f168. Resources: {'key_pairs'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:30:54.596261 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-883bc4c0-71e4-4999-bc1d-948b83df21be tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Getting quotas for user c2fe2da4d72e4522ac8bbb7c9a58381a and project bd571e41b44a4bc6b16bf8163252f168. Resources: {'key_pairs'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:30:54.610525 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-883bc4c0-71e4-4999-bc1d-948b83df21be tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.319691 May 03 21:30:54.611129 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 132/248] 10.222.0.48 () {60 vars in 1157 bytes} [Tue May 3 21:30:54 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:30:54.873688 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-22a5bc73-a35c-4255-a142-c00c2b9d9c60 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Action: 'create', calling method: .version_select at 0x7fc84cd92820>, body: {"keypair": {"name": "tempest-keypair-494500117"}} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:30:54.903647 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-22a5bc73-a35c-4255-a142-c00c2b9d9c60 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Getting quotas for project 30468ebc688d4bc1b036b4b984931e87. Resources: {'key_pairs'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:30:54.907680 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-22a5bc73-a35c-4255-a142-c00c2b9d9c60 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Getting quotas for user 5a12cc655c2c404e928b2e1bb44c64e4 and project 30468ebc688d4bc1b036b4b984931e87. Resources: {'key_pairs'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:30:55.179499 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-22a5bc73-a35c-4255-a142-c00c2b9d9c60 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Getting quotas for project 30468ebc688d4bc1b036b4b984931e87. Resources: {'key_pairs'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:30:55.184385 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-22a5bc73-a35c-4255-a142-c00c2b9d9c60 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Getting quotas for user 5a12cc655c2c404e928b2e1bb44c64e4 and project 30468ebc688d4bc1b036b4b984931e87. Resources: {'key_pairs'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:30:55.198753 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-22a5bc73-a35c-4255-a142-c00c2b9d9c60 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.335276 May 03 21:30:55.199330 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 117/249] 10.222.0.48 () {60 vars in 1157 bytes} [Tue May 3 21:30:54 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:30:55.681308 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-5edaa2b5-adac-482e-9e16-20f110855143 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1110979181", "imageRef": "f5214328-64f1-4aa6-aa05-61f0189e0e1e", "flavorRef": "452", "networks": [{"uuid": "8728a8ce-db6a-4720-bb6e-c96e6c9ab260"}]}} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:30:55.771764 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.network.neutron [None req-5edaa2b5-adac-482e-9e16-20f110855143 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] validate_networks() for [('8728a8ce-db6a-4720-bb6e-c96e6c9ab260', None, None, None)] {{(pid=97832) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} May 03 21:30:56.521993 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-a30192b4-1805-4f1d-8795-9b83ab72bde8 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:56.524661 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-a30192b4-1805-4f1d-8795-9b83ab72bde8 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:56.556137 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a30192b4-1805-4f1d-8795-9b83ab72bde8 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:56.559839 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a30192b4-1805-4f1d-8795-9b83ab72bde8 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:56.562158 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a30192b4-1805-4f1d-8795-9b83ab72bde8 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:56.562842 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a30192b4-1805-4f1d-8795-9b83ab72bde8 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:56.622641 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-5edaa2b5-adac-482e-9e16-20f110855143 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Flavor limits 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} May 03 21:30:56.625811 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-5edaa2b5-adac-482e-9e16-20f110855143 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Image limits 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} May 03 21:30:56.626611 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-5edaa2b5-adac-482e-9e16-20f110855143 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Flavor pref 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} May 03 21:30:56.627240 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-5edaa2b5-adac-482e-9e16-20f110855143 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Image pref 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} May 03 21:30:56.628699 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-5edaa2b5-adac-482e-9e16-20f110855143 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} May 03 21:30:56.653385 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5edaa2b5-adac-482e-9e16-20f110855143 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:56.654134 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5edaa2b5-adac-482e-9e16-20f110855143 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:56.656028 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5edaa2b5-adac-482e-9e16-20f110855143 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:56.662795 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5edaa2b5-adac-482e-9e16-20f110855143 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:56.680501 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-a30192b4-1805-4f1d-8795-9b83ab72bde8 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5/ips" status: 200 len: 152 microversion: 2.20 time: 0.178454 May 03 21:30:56.683042 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 118/250] 10.222.0.48 () {60 vars in 1288 bytes} [Tue May 3 21:30:56 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5/ips => generated 152 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 03 21:30:56.707826 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-5edaa2b5-adac-482e-9e16-20f110855143 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Getting quotas for project ed2eb47de9ab494c8061632f766f1050. Resources: {'instances', 'ram', 'cores'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:30:56.712172 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-5edaa2b5-adac-482e-9e16-20f110855143 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Getting quotas for user ce53c9c393cd431aa932c98352644d89 and project ed2eb47de9ab494c8061632f766f1050. Resources: {'instances', 'ram', 'cores'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:30:56.726504 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-5edaa2b5-adac-482e-9e16-20f110855143 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Going to run 1 instances... {{(pid=97832) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} May 03 21:30:56.730454 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-5edaa2b5-adac-482e-9e16-20f110855143 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: 3849d6f2-1dba-4e09-956d-54d873eea387] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5214328-64f1-4aa6-aa05-61f0189e0e1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=97832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} May 03 21:30:56.902003 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-5edaa2b5-adac-482e-9e16-20f110855143 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.237286 May 03 21:30:56.903038 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 133/251] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 3 21:30:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1239 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 03 21:30:56.923372 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-20032f37-9fc6-49df-94ee-f65c4c079af0 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:56.924001 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-20032f37-9fc6-49df-94ee-f65c4c079af0 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: 3849d6f2-1dba-4e09-956d-54d873eea387] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:57.058773 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-20032f37-9fc6-49df-94ee-f65c4c079af0 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:57.064058 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-20032f37-9fc6-49df-94ee-f65c4c079af0 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387" status: 200 len: 1214 microversion: 2.1 time: 0.154356 May 03 21:30:57.065071 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 119/252] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:56 2022] GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387 => generated 1214 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:30:58.089729 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-c992b37c-3d7a-4adc-b498-1174417b36e3 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:58.090437 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-c992b37c-3d7a-4adc-b498-1174417b36e3 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: 3849d6f2-1dba-4e09-956d-54d873eea387] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:58.219383 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-c992b37c-3d7a-4adc-b498-1174417b36e3 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:30:58.234794 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-c992b37c-3d7a-4adc-b498-1174417b36e3 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387" status: 200 len: 1214 microversion: 2.1 time: 0.155395 May 03 21:30:58.238076 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 134/253] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:58 2022] GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387 => generated 1214 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:30:58.521209 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-5c13c2cb-34c3-4348-a59e-424bd10de6b1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1589759873", "imageRef": "f5214328-64f1-4aa6-aa05-61f0189e0e1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "afa29ce3-7ea1-4fb3-8d15-b28913382476"}], "security_groups": [{"name": "tempest-securitygroup--1346592466"}], "key_name": "tempest-keypair-2139605624", "user_data": "}} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:30:58.911675 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.network.neutron [None req-5c13c2cb-34c3-4348-a59e-424bd10de6b1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] validate_networks() for [('afa29ce3-7ea1-4fb3-8d15-b28913382476', None, None, None)] {{(pid=97831) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} May 03 21:30:59.032604 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-2889468c-a66b-45a6-83cd-a74b8ef36bcc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-237802077", "imageRef": "f5214328-64f1-4aa6-aa05-61f0189e0e1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5bd090d5-a93e-4f68-8601-6aad9d3eb473"}], "security_groups": [{"name": "tempest-securitygroup--2136042783"}], "key_name": "tempest-keypair-494500117", "user_data": "}} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:30:59.174523 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.network.neutron [None req-2889468c-a66b-45a6-83cd-a74b8ef36bcc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] validate_networks() for [('5bd090d5-a93e-4f68-8601-6aad9d3eb473', None, None, None)] {{(pid=97832) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} May 03 21:30:59.559672 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-5c13c2cb-34c3-4348-a59e-424bd10de6b1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Flavor limits 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} May 03 21:30:59.560184 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-5c13c2cb-34c3-4348-a59e-424bd10de6b1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Image limits 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} May 03 21:30:59.560564 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-5c13c2cb-34c3-4348-a59e-424bd10de6b1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Flavor pref 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} May 03 21:30:59.560967 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-5c13c2cb-34c3-4348-a59e-424bd10de6b1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Image pref 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} May 03 21:30:59.561373 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-5c13c2cb-34c3-4348-a59e-424bd10de6b1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} May 03 21:30:59.570459 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5c13c2cb-34c3-4348-a59e-424bd10de6b1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:59.570912 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5c13c2cb-34c3-4348-a59e-424bd10de6b1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:59.571706 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5c13c2cb-34c3-4348-a59e-424bd10de6b1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:59.572451 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5c13c2cb-34c3-4348-a59e-424bd10de6b1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:59.591069 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-5c13c2cb-34c3-4348-a59e-424bd10de6b1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Getting quotas for project bd571e41b44a4bc6b16bf8163252f168. Resources: {'instances', 'ram', 'cores'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:30:59.595487 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-5c13c2cb-34c3-4348-a59e-424bd10de6b1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Getting quotas for user c2fe2da4d72e4522ac8bbb7c9a58381a and project bd571e41b44a4bc6b16bf8163252f168. Resources: {'instances', 'ram', 'cores'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:30:59.612661 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-5c13c2cb-34c3-4348-a59e-424bd10de6b1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Going to run 1 instances... {{(pid=97831) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} May 03 21:30:59.615100 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-5c13c2cb-34c3-4348-a59e-424bd10de6b1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5214328-64f1-4aa6-aa05-61f0189e0e1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=97831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} May 03 21:30:59.751072 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-2889468c-a66b-45a6-83cd-a74b8ef36bcc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Flavor limits 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} May 03 21:30:59.751536 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-2889468c-a66b-45a6-83cd-a74b8ef36bcc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Image limits 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} May 03 21:30:59.752014 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-2889468c-a66b-45a6-83cd-a74b8ef36bcc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Flavor pref 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} May 03 21:30:59.752457 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-2889468c-a66b-45a6-83cd-a74b8ef36bcc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Image pref 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} May 03 21:30:59.753101 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-2889468c-a66b-45a6-83cd-a74b8ef36bcc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} May 03 21:30:59.756351 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-5c13c2cb-34c3-4348-a59e-424bd10de6b1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.244779 May 03 21:30:59.757461 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 120/254] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 3 21:30:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 1246 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 03 21:30:59.764580 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2889468c-a66b-45a6-83cd-a74b8ef36bcc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:59.765625 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2889468c-a66b-45a6-83cd-a74b8ef36bcc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:59.766642 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2889468c-a66b-45a6-83cd-a74b8ef36bcc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:59.767269 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2889468c-a66b-45a6-83cd-a74b8ef36bcc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:59.768635 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-0f8f95a8-f8af-47e6-9b87-57a19428f363 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:30:59.781362 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-0f8f95a8-f8af-47e6-9b87-57a19428f363 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: 3849d6f2-1dba-4e09-956d-54d873eea387] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:30:59.789918 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0f8f95a8-f8af-47e6-9b87-57a19428f363 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:59.790396 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0f8f95a8-f8af-47e6-9b87-57a19428f363 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:59.791797 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0f8f95a8-f8af-47e6-9b87-57a19428f363 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:30:59.792233 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0f8f95a8-f8af-47e6-9b87-57a19428f363 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:30:59.795107 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-2889468c-a66b-45a6-83cd-a74b8ef36bcc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Getting quotas for project 30468ebc688d4bc1b036b4b984931e87. Resources: {'instances', 'ram', 'cores'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:30:59.802066 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-2889468c-a66b-45a6-83cd-a74b8ef36bcc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Getting quotas for user 5a12cc655c2c404e928b2e1bb44c64e4 and project 30468ebc688d4bc1b036b4b984931e87. Resources: {'instances', 'ram', 'cores'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:30:59.814611 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-2889468c-a66b-45a6-83cd-a74b8ef36bcc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Going to run 1 instances... {{(pid=97832) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} May 03 21:30:59.817646 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-2889468c-a66b-45a6-83cd-a74b8ef36bcc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5214328-64f1-4aa6-aa05-61f0189e0e1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=97832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} May 03 21:30:59.966720 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-2889468c-a66b-45a6-83cd-a74b8ef36bcc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.942755 May 03 21:30:59.967488 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 135/255] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 3 21:30:59 2022] POST /compute/v2.1/servers => generated 409 bytes in 948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 03 21:30:59.977024 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-0f8f95a8-f8af-47e6-9b87-57a19428f363 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:00.005447 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-0f8f95a8-f8af-47e6-9b87-57a19428f363 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387" status: 200 len: 1266 microversion: 2.1 time: 0.236363 May 03 21:31:00.007811 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 121/256] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:30:59 2022] GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387 => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:00.016284 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-e707fe6d-402b-4e2e-8769-8e3386406f18 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:31:00.017049 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-e707fe6d-402b-4e2e-8769-8e3386406f18 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:00.025252 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e707fe6d-402b-4e2e-8769-8e3386406f18 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:00.026395 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e707fe6d-402b-4e2e-8769-8e3386406f18 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:00.027835 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e707fe6d-402b-4e2e-8769-8e3386406f18 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:00.028553 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e707fe6d-402b-4e2e-8769-8e3386406f18 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:00.032890 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-638d7462-6fa6-4e00-a437-c048740ee8c4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:00.036875 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-638d7462-6fa6-4e00-a437-c048740ee8c4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:00.121666 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.objects.instance [None req-e707fe6d-402b-4e2e-8769-8e3386406f18 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lazy-loading 'flavor' on Instance uuid 77f6a8a2-4366-486d-a002-05587e0f46b5 {{(pid=97832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 03 21:31:00.201677 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-638d7462-6fa6-4e00-a437-c048740ee8c4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:00.217079 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-638d7462-6fa6-4e00-a437-c048740ee8c4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f" status: 200 len: 1242 microversion: 2.1 time: 0.209762 May 03 21:31:00.218386 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 122/257] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:00 2022] GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f => generated 1242 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:00.230814 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-e49be4ea-4a2c-4c7b-95fb-85062a8eaba0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:00.231801 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-e49be4ea-4a2c-4c7b-95fb-85062a8eaba0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:00.347867 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-e49be4ea-4a2c-4c7b-95fb-85062a8eaba0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:00.361135 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-e49be4ea-4a2c-4c7b-95fb-85062a8eaba0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1244 microversion: 2.1 time: 0.141469 May 03 21:31:00.361710 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 123/258] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:00 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1244 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:01.043712 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-090e831c-3d10-4dc7-a8d6-fa0e979b080f tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:01.045136 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-090e831c-3d10-4dc7-a8d6-fa0e979b080f tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: 3849d6f2-1dba-4e09-956d-54d873eea387] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:01.050776 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-e707fe6d-402b-4e2e-8769-8e3386406f18 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "POST /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5/action" status: 202 len: 0 microversion: 2.20 time: 1.081998 May 03 21:31:01.055134 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 136/259] 10.222.0.48 () {62 vars in 1318 bytes} [Tue May 3 21:30:59 2022] POST /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5/action => generated 0 bytes in 1084 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 03 21:31:01.070285 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-090e831c-3d10-4dc7-a8d6-fa0e979b080f tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:01.070877 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-090e831c-3d10-4dc7-a8d6-fa0e979b080f tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:01.071799 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-090e831c-3d10-4dc7-a8d6-fa0e979b080f tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:01.073646 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-090e831c-3d10-4dc7-a8d6-fa0e979b080f tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:01.084139 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-f48a89a0-b5e4-464f-a993-101bfb121fa0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:01.085032 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-f48a89a0-b5e4-464f-a993-101bfb121fa0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:01.106606 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f48a89a0-b5e4-464f-a993-101bfb121fa0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:01.107248 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f48a89a0-b5e4-464f-a993-101bfb121fa0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:01.108396 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f48a89a0-b5e4-464f-a993-101bfb121fa0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:01.110288 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f48a89a0-b5e4-464f-a993-101bfb121fa0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:01.280830 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-090e831c-3d10-4dc7-a8d6-fa0e979b080f tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:01.289549 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-090e831c-3d10-4dc7-a8d6-fa0e979b080f tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387" status: 200 len: 1272 microversion: 2.1 time: 0.270129 May 03 21:31:01.299463 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 124/260] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:01 2022] GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387 => generated 1272 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:31:01.311342 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-4794c7b2-a9b3-4e68-b39c-57f5f2520e6e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:01.312064 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-4794c7b2-a9b3-4e68-b39c-57f5f2520e6e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:01.323564 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4794c7b2-a9b3-4e68-b39c-57f5f2520e6e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:01.324134 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4794c7b2-a9b3-4e68-b39c-57f5f2520e6e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:01.325199 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4794c7b2-a9b3-4e68-b39c-57f5f2520e6e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:01.325636 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4794c7b2-a9b3-4e68-b39c-57f5f2520e6e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:01.381080 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-f48a89a0-b5e4-464f-a993-101bfb121fa0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:01.400036 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-f48a89a0-b5e4-464f-a993-101bfb121fa0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:01.408122 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-f48a89a0-b5e4-464f-a993-101bfb121fa0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:01.409806 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-f48a89a0-b5e4-464f-a993-101bfb121fa0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1723 microversion: 2.20 time: 0.348446 May 03 21:31:01.410582 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 137/261] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:01 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1723 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:31:01.422791 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-27c2eb40-da40-47c6-a93a-80d8e0c219b4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:01.423704 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-27c2eb40-da40-47c6-a93a-80d8e0c219b4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:01.432863 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-27c2eb40-da40-47c6-a93a-80d8e0c219b4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:01.433435 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-27c2eb40-da40-47c6-a93a-80d8e0c219b4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:01.434280 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-27c2eb40-da40-47c6-a93a-80d8e0c219b4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:01.434774 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-27c2eb40-da40-47c6-a93a-80d8e0c219b4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:01.512097 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-4794c7b2-a9b3-4e68-b39c-57f5f2520e6e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:01.525859 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-4794c7b2-a9b3-4e68-b39c-57f5f2520e6e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f" status: 200 len: 1246 microversion: 2.1 time: 0.224193 May 03 21:31:01.527676 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 125/262] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:01 2022] GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f => generated 1246 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:01.583273 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-27c2eb40-da40-47c6-a93a-80d8e0c219b4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:01.593483 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-27c2eb40-da40-47c6-a93a-80d8e0c219b4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1248 microversion: 2.1 time: 0.181682 May 03 21:31:01.594055 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 138/263] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:01 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1248 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:02.318440 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-b7268b49-0ed1-4db6-b4d2-69cce8da5192 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:02.319267 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-b7268b49-0ed1-4db6-b4d2-69cce8da5192 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: 3849d6f2-1dba-4e09-956d-54d873eea387] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:02.328209 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b7268b49-0ed1-4db6-b4d2-69cce8da5192 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:02.329046 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b7268b49-0ed1-4db6-b4d2-69cce8da5192 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:02.330494 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b7268b49-0ed1-4db6-b4d2-69cce8da5192 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:02.331285 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b7268b49-0ed1-4db6-b4d2-69cce8da5192 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:02.436244 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-011d4a28-2821-4e8d-a4bb-062643551f46 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:02.436810 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-011d4a28-2821-4e8d-a4bb-062643551f46 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:02.447318 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-011d4a28-2821-4e8d-a4bb-062643551f46 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:02.447773 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-011d4a28-2821-4e8d-a4bb-062643551f46 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:02.448700 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-011d4a28-2821-4e8d-a4bb-062643551f46 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:02.449172 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-011d4a28-2821-4e8d-a4bb-062643551f46 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:02.642385 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-b7268b49-0ed1-4db6-b4d2-69cce8da5192 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:02.651952 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-b7268b49-0ed1-4db6-b4d2-69cce8da5192 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387" status: 200 len: 1314 microversion: 2.1 time: 0.342358 May 03 21:31:02.653477 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 126/264] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:02 2022] GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:02.662959 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-f7307736-355f-41cc-b41f-50a16a1735e1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:02.663568 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-f7307736-355f-41cc-b41f-50a16a1735e1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:02.671697 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f7307736-355f-41cc-b41f-50a16a1735e1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:02.672225 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f7307736-355f-41cc-b41f-50a16a1735e1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:02.673060 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f7307736-355f-41cc-b41f-50a16a1735e1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:02.673496 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f7307736-355f-41cc-b41f-50a16a1735e1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:02.683221 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-011d4a28-2821-4e8d-a4bb-062643551f46 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:02.698408 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-011d4a28-2821-4e8d-a4bb-062643551f46 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:02.705288 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-011d4a28-2821-4e8d-a4bb-062643551f46 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:02.707756 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-011d4a28-2821-4e8d-a4bb-062643551f46 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1723 microversion: 2.20 time: 0.280391 May 03 21:31:02.707756 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 139/265] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:02 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1723 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:31:02.718974 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-3b84962a-17d9-42c8-9342-5617b79c836f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:02.719595 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-3b84962a-17d9-42c8-9342-5617b79c836f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:02.726814 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3b84962a-17d9-42c8-9342-5617b79c836f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:02.727268 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3b84962a-17d9-42c8-9342-5617b79c836f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:02.728784 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3b84962a-17d9-42c8-9342-5617b79c836f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:02.729600 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3b84962a-17d9-42c8-9342-5617b79c836f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:02.798970 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-f7307736-355f-41cc-b41f-50a16a1735e1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:02.807303 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-f7307736-355f-41cc-b41f-50a16a1735e1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f" status: 200 len: 1294 microversion: 2.1 time: 0.153293 May 03 21:31:02.807849 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 127/266] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:02 2022] GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f => generated 1294 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:02.855979 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-3b84962a-17d9-42c8-9342-5617b79c836f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:02.864035 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-3b84962a-17d9-42c8-9342-5617b79c836f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1240 microversion: 2.1 time: 0.155489 May 03 21:31:02.864595 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 140/267] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:02 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1240 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:03.675752 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-b33deee1-a8ca-42fe-9cd1-166c8bffd9aa tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:03.676356 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-b33deee1-a8ca-42fe-9cd1-166c8bffd9aa tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: 3849d6f2-1dba-4e09-956d-54d873eea387] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:03.684685 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b33deee1-a8ca-42fe-9cd1-166c8bffd9aa tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:03.685129 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b33deee1-a8ca-42fe-9cd1-166c8bffd9aa tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:03.685893 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b33deee1-a8ca-42fe-9cd1-166c8bffd9aa tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:03.686319 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b33deee1-a8ca-42fe-9cd1-166c8bffd9aa tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:03.731888 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-c52b51a1-f990-4a15-bcab-ec0b79d3de44 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:03.732514 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-c52b51a1-f990-4a15-bcab-ec0b79d3de44 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:03.740124 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c52b51a1-f990-4a15-bcab-ec0b79d3de44 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:03.740688 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c52b51a1-f990-4a15-bcab-ec0b79d3de44 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:03.741464 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c52b51a1-f990-4a15-bcab-ec0b79d3de44 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:03.741899 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c52b51a1-f990-4a15-bcab-ec0b79d3de44 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:03.900133 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-b33deee1-a8ca-42fe-9cd1-166c8bffd9aa tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:03.908594 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-b33deee1-a8ca-42fe-9cd1-166c8bffd9aa tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387" status: 200 len: 1314 microversion: 2.1 time: 0.242970 May 03 21:31:03.909148 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 128/268] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:03 2022] GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:03.919520 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-fae94fbe-3052-4846-9f45-cc552ce76876 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:03.920135 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-fae94fbe-3052-4846-9f45-cc552ce76876 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:03.927813 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fae94fbe-3052-4846-9f45-cc552ce76876 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:03.928205 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fae94fbe-3052-4846-9f45-cc552ce76876 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:03.929015 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fae94fbe-3052-4846-9f45-cc552ce76876 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:03.929450 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fae94fbe-3052-4846-9f45-cc552ce76876 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:03.960213 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-c52b51a1-f990-4a15-bcab-ec0b79d3de44 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:03.974293 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-c52b51a1-f990-4a15-bcab-ec0b79d3de44 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:03.981208 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-c52b51a1-f990-4a15-bcab-ec0b79d3de44 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:03.982803 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-c52b51a1-f990-4a15-bcab-ec0b79d3de44 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1723 microversion: 2.20 time: 0.261063 May 03 21:31:03.994834 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 141/269] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:03 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 21:31:03.994834 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-b5f9ad1b-c0ec-4ebe-bb45-b978d1624c1e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:03.994834 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-b5f9ad1b-c0ec-4ebe-bb45-b978d1624c1e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:04.001904 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b5f9ad1b-c0ec-4ebe-bb45-b978d1624c1e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:04.002356 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b5f9ad1b-c0ec-4ebe-bb45-b978d1624c1e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:04.003129 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b5f9ad1b-c0ec-4ebe-bb45-b978d1624c1e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:04.003557 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b5f9ad1b-c0ec-4ebe-bb45-b978d1624c1e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:04.067144 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-fae94fbe-3052-4846-9f45-cc552ce76876 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:04.083954 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-fae94fbe-3052-4846-9f45-cc552ce76876 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f" status: 200 len: 1294 microversion: 2.1 time: 0.173757 May 03 21:31:04.084689 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 129/270] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:03 2022] GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f => generated 1294 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:04.131011 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-b5f9ad1b-c0ec-4ebe-bb45-b978d1624c1e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:04.139369 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-b5f9ad1b-c0ec-4ebe-bb45-b978d1624c1e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1240 microversion: 2.1 time: 0.155046 May 03 21:31:04.139963 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 142/271] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:03 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1240 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:04.930848 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-e7262e13-634f-4b2b-9da4-4b1f432538d7 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:04.932571 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-e7262e13-634f-4b2b-9da4-4b1f432538d7 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: 3849d6f2-1dba-4e09-956d-54d873eea387] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:04.939864 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e7262e13-634f-4b2b-9da4-4b1f432538d7 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:04.941005 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e7262e13-634f-4b2b-9da4-4b1f432538d7 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:04.941171 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e7262e13-634f-4b2b-9da4-4b1f432538d7 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:04.941495 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e7262e13-634f-4b2b-9da4-4b1f432538d7 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:05.008250 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-62a0ed9c-5af3-4533-b3dc-50ae349fb6e2 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:05.010439 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-62a0ed9c-5af3-4533-b3dc-50ae349fb6e2 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:05.018612 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-62a0ed9c-5af3-4533-b3dc-50ae349fb6e2 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:05.019059 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-62a0ed9c-5af3-4533-b3dc-50ae349fb6e2 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:05.019823 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-62a0ed9c-5af3-4533-b3dc-50ae349fb6e2 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:05.021085 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-62a0ed9c-5af3-4533-b3dc-50ae349fb6e2 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:05.278356 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-62a0ed9c-5af3-4533-b3dc-50ae349fb6e2 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:05.292451 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-62a0ed9c-5af3-4533-b3dc-50ae349fb6e2 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:05.298737 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-62a0ed9c-5af3-4533-b3dc-50ae349fb6e2 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:05.299862 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-62a0ed9c-5af3-4533-b3dc-50ae349fb6e2 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1723 microversion: 2.20 time: 0.301443 May 03 21:31:05.300781 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 143/272] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:04 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1723 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 21:31:05.311756 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-c8c05b22-a002-48cb-ab88-ad8f7fa3e3b3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:05.312371 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-c8c05b22-a002-48cb-ab88-ad8f7fa3e3b3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:05.323801 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c8c05b22-a002-48cb-ab88-ad8f7fa3e3b3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:05.323801 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c8c05b22-a002-48cb-ab88-ad8f7fa3e3b3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:05.323801 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c8c05b22-a002-48cb-ab88-ad8f7fa3e3b3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:05.323801 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c8c05b22-a002-48cb-ab88-ad8f7fa3e3b3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:05.345389 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-e7262e13-634f-4b2b-9da4-4b1f432538d7 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:05.354526 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-e7262e13-634f-4b2b-9da4-4b1f432538d7 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387" status: 200 len: 1314 microversion: 2.1 time: 0.432596 May 03 21:31:05.355509 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 130/273] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:04 2022] GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387 => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:05.366979 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-e93487e9-3186-45cc-952e-2359da9c8fe6 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:05.367611 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-e93487e9-3186-45cc-952e-2359da9c8fe6 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:05.376109 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e93487e9-3186-45cc-952e-2359da9c8fe6 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:05.376678 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e93487e9-3186-45cc-952e-2359da9c8fe6 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:05.377545 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e93487e9-3186-45cc-952e-2359da9c8fe6 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:05.378041 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e93487e9-3186-45cc-952e-2359da9c8fe6 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:05.456761 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-c8c05b22-a002-48cb-ab88-ad8f7fa3e3b3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:05.465316 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-c8c05b22-a002-48cb-ab88-ad8f7fa3e3b3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f" status: 200 len: 1294 microversion: 2.1 time: 0.163419 May 03 21:31:05.465859 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 144/274] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:05 2022] GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f => generated 1294 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:05.540446 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-e93487e9-3186-45cc-952e-2359da9c8fe6 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:05.550037 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-e93487e9-3186-45cc-952e-2359da9c8fe6 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1240 microversion: 2.1 time: 0.192033 May 03 21:31:05.550590 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 131/275] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:05 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1240 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:05.582539 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-28f052a6-217e-4023-b4fe-ec44b11bf3e9 req-ae6ee37d-cf5f-471a-8647-b8d232c808a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3849d6f2-1dba-4e09-956d-54d873eea387", "tag": "ee0150a2-32c4-464b-8988-0efae2a38c5c"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:31:05.589758 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:31:05.589758 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:31:05.598587 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-28f052a6-217e-4023-b4fe-ec44b11bf3e9 req-ae6ee37d-cf5f-471a-8647-b8d232c808a4 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:05.599026 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-28f052a6-217e-4023-b4fe-ec44b11bf3e9 req-ae6ee37d-cf5f-471a-8647-b8d232c808a4 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:05.615323 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-28f052a6-217e-4023-b4fe-ec44b11bf3e9 req-ae6ee37d-cf5f-471a-8647-b8d232c808a4 service nova] Creating event network-changed:ee0150a2-32c4-464b-8988-0efae2a38c5c for instance 3849d6f2-1dba-4e09-956d-54d873eea387 on hv-cinder-84037 May 03 21:31:05.620483 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-28f052a6-217e-4023-b4fe-ec44b11bf3e9 req-ae6ee37d-cf5f-471a-8647-b8d232c808a4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047157 May 03 21:31:05.621096 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 145/276] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:31:05.678413 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-2c436df3-1a6e-43a9-ac11-3e8a032e3d14 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:31:05.685855 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2c436df3-1a6e-43a9-ac11-3e8a032e3d14 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:05.686304 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2c436df3-1a6e-43a9-ac11-3e8a032e3d14 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:05.747849 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-2c436df3-1a6e-43a9-ac11-3e8a032e3d14 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Going to try to stop instance {{(pid=97831) force_stop /opt/stack/nova/nova/compute/api.py:2599}} May 03 21:31:05.977170 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-2c436df3-1a6e-43a9-ac11-3e8a032e3d14 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "POST /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a/action" status: 202 len: 0 microversion: 2.1 time: 0.307341 May 03 21:31:05.977794 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 132/277] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 3 21:31:05 2022] POST /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 21:31:05.992550 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-f0cb50ac-6ba2-4149-9663-edb966fb6d7d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:05.993242 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-f0cb50ac-6ba2-4149-9663-edb966fb6d7d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:06.001225 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f0cb50ac-6ba2-4149-9663-edb966fb6d7d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:06.001670 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f0cb50ac-6ba2-4149-9663-edb966fb6d7d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:06.002428 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f0cb50ac-6ba2-4149-9663-edb966fb6d7d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:06.002900 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f0cb50ac-6ba2-4149-9663-edb966fb6d7d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:06.212907 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-f0cb50ac-6ba2-4149-9663-edb966fb6d7d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:06.222267 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-f0cb50ac-6ba2-4149-9663-edb966fb6d7d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1722 microversion: 2.1 time: 0.239854 May 03 21:31:06.222795 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 146/278] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:05 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:06.326647 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-52ad64c1-38c5-4373-bd2a-7115fac098a4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:06.327340 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-52ad64c1-38c5-4373-bd2a-7115fac098a4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:06.334841 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-52ad64c1-38c5-4373-bd2a-7115fac098a4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:06.335278 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-52ad64c1-38c5-4373-bd2a-7115fac098a4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:06.337054 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-52ad64c1-38c5-4373-bd2a-7115fac098a4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:06.337054 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-52ad64c1-38c5-4373-bd2a-7115fac098a4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:06.377638 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-e8889f6d-b100-411c-b9cc-1475b0171c27 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:06.378439 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-e8889f6d-b100-411c-b9cc-1475b0171c27 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: 3849d6f2-1dba-4e09-956d-54d873eea387] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:06.394426 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e8889f6d-b100-411c-b9cc-1475b0171c27 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:06.394426 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e8889f6d-b100-411c-b9cc-1475b0171c27 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:06.394426 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e8889f6d-b100-411c-b9cc-1475b0171c27 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:06.394426 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e8889f6d-b100-411c-b9cc-1475b0171c27 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:06.582608 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-52ad64c1-38c5-4373-bd2a-7115fac098a4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:06.597343 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-52ad64c1-38c5-4373-bd2a-7115fac098a4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:06.604102 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-52ad64c1-38c5-4373-bd2a-7115fac098a4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:06.605366 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-52ad64c1-38c5-4373-bd2a-7115fac098a4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1723 microversion: 2.20 time: 0.289928 May 03 21:31:06.605900 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 133/279] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:06 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1723 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 21:31:06.615535 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-c1e6c69e-87b0-45e3-a5a6-45e8995b789e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:06.616142 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-c1e6c69e-87b0-45e3-a5a6-45e8995b789e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:06.624286 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c1e6c69e-87b0-45e3-a5a6-45e8995b789e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:06.624783 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c1e6c69e-87b0-45e3-a5a6-45e8995b789e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:06.625563 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c1e6c69e-87b0-45e3-a5a6-45e8995b789e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:06.625995 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c1e6c69e-87b0-45e3-a5a6-45e8995b789e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:06.730517 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-e8889f6d-b100-411c-b9cc-1475b0171c27 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:06.738717 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-e8889f6d-b100-411c-b9cc-1475b0171c27 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387" status: 200 len: 1314 microversion: 2.1 time: 0.371548 May 03 21:31:06.739267 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 147/280] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:06 2022] GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387 => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:31:06.750188 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-60879529-013a-4d23-b6de-e30302646347 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:06.750789 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-60879529-013a-4d23-b6de-e30302646347 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:06.756338 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-c1e6c69e-87b0-45e3-a5a6-45e8995b789e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:06.758209 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-60879529-013a-4d23-b6de-e30302646347 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:06.758657 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-60879529-013a-4d23-b6de-e30302646347 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:06.759969 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-60879529-013a-4d23-b6de-e30302646347 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:06.760405 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-60879529-013a-4d23-b6de-e30302646347 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:06.765617 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-c1e6c69e-87b0-45e3-a5a6-45e8995b789e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f" status: 200 len: 1294 microversion: 2.1 time: 0.158706 May 03 21:31:06.766153 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 134/281] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:06 2022] GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f => generated 1294 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:06.933927 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-60879529-013a-4d23-b6de-e30302646347 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:06.942101 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-60879529-013a-4d23-b6de-e30302646347 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1240 microversion: 2.1 time: 0.201884 May 03 21:31:06.942630 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 148/282] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:06 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1240 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:07.245489 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-d4bea067-137d-4866-9117-e94d020cbec8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:07.246210 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-d4bea067-137d-4866-9117-e94d020cbec8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:07.253508 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d4bea067-137d-4866-9117-e94d020cbec8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:07.253962 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d4bea067-137d-4866-9117-e94d020cbec8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:07.254741 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d4bea067-137d-4866-9117-e94d020cbec8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:07.255183 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d4bea067-137d-4866-9117-e94d020cbec8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:07.635861 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-d4bea067-137d-4866-9117-e94d020cbec8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:07.636721 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-39c927f3-f3e2-4bbd-b48f-b89738e16a5e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:07.637413 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-39c927f3-f3e2-4bbd-b48f-b89738e16a5e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:07.645697 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-d4bea067-137d-4866-9117-e94d020cbec8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1722 microversion: 2.1 time: 0.410102 May 03 21:31:07.648330 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 135/283] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:07 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1722 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:07.658303 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-39c927f3-f3e2-4bbd-b48f-b89738e16a5e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:07.658753 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-39c927f3-f3e2-4bbd-b48f-b89738e16a5e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:07.659541 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-39c927f3-f3e2-4bbd-b48f-b89738e16a5e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:07.659978 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-39c927f3-f3e2-4bbd-b48f-b89738e16a5e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:07.766390 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-aae91d54-13b3-4da8-a6bc-2eefba039547 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:07.767626 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-aae91d54-13b3-4da8-a6bc-2eefba039547 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: 3849d6f2-1dba-4e09-956d-54d873eea387] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:07.778643 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-aae91d54-13b3-4da8-a6bc-2eefba039547 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:07.779571 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-aae91d54-13b3-4da8-a6bc-2eefba039547 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:07.781123 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-aae91d54-13b3-4da8-a6bc-2eefba039547 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:07.781758 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-aae91d54-13b3-4da8-a6bc-2eefba039547 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:07.892759 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-39c927f3-f3e2-4bbd-b48f-b89738e16a5e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:07.908642 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-39c927f3-f3e2-4bbd-b48f-b89738e16a5e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:07.914807 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-39c927f3-f3e2-4bbd-b48f-b89738e16a5e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:07.916540 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-39c927f3-f3e2-4bbd-b48f-b89738e16a5e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1723 microversion: 2.20 time: 0.290075 May 03 21:31:07.919012 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 149/284] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:07 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1723 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 21:31:07.930647 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-3cd71bb6-1f8b-457f-9f49-a68ff9fccd52 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:07.931553 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-3cd71bb6-1f8b-457f-9f49-a68ff9fccd52 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:07.940650 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3cd71bb6-1f8b-457f-9f49-a68ff9fccd52 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:07.941384 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3cd71bb6-1f8b-457f-9f49-a68ff9fccd52 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:07.942429 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3cd71bb6-1f8b-457f-9f49-a68ff9fccd52 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:07.943050 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3cd71bb6-1f8b-457f-9f49-a68ff9fccd52 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:08.123933 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-3cd71bb6-1f8b-457f-9f49-a68ff9fccd52 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:08.136113 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-3cd71bb6-1f8b-457f-9f49-a68ff9fccd52 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f" status: 200 len: 1302 microversion: 2.1 time: 0.215416 May 03 21:31:08.137190 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 150/285] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:07 2022] GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f => generated 1302 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:08.153272 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-c6f55dbb-9115-49a6-a9fc-a39ae2dc2590 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:08.156715 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-c6f55dbb-9115-49a6-a9fc-a39ae2dc2590 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:08.164076 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c6f55dbb-9115-49a6-a9fc-a39ae2dc2590 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:08.164562 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c6f55dbb-9115-49a6-a9fc-a39ae2dc2590 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:08.166232 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c6f55dbb-9115-49a6-a9fc-a39ae2dc2590 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:08.167000 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c6f55dbb-9115-49a6-a9fc-a39ae2dc2590 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:08.258746 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-aae91d54-13b3-4da8-a6bc-2eefba039547 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:08.273138 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-aae91d54-13b3-4da8-a6bc-2eefba039547 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387" status: 200 len: 1314 microversion: 2.1 time: 0.516790 May 03 21:31:08.283204 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 136/286] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:07 2022] GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387 => generated 1314 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:31:08.304575 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-c6f55dbb-9115-49a6-a9fc-a39ae2dc2590 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:08.314017 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-c6f55dbb-9115-49a6-a9fc-a39ae2dc2590 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1296 microversion: 2.1 time: 0.175621 May 03 21:31:08.314644 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 151/287] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:08 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1296 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:08.670758 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-1aa5204f-7eda-48d7-a1ba-9e3295188de3 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:08.671374 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-1aa5204f-7eda-48d7-a1ba-9e3295188de3 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:08.679441 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1aa5204f-7eda-48d7-a1ba-9e3295188de3 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:08.680138 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1aa5204f-7eda-48d7-a1ba-9e3295188de3 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:08.681519 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1aa5204f-7eda-48d7-a1ba-9e3295188de3 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:08.682120 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1aa5204f-7eda-48d7-a1ba-9e3295188de3 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:08.949377 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-b6b97b60-a684-499d-ac42-728204bc8683 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:08.950155 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-b6b97b60-a684-499d-ac42-728204bc8683 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:08.959716 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b6b97b60-a684-499d-ac42-728204bc8683 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:08.960577 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b6b97b60-a684-499d-ac42-728204bc8683 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:08.961379 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b6b97b60-a684-499d-ac42-728204bc8683 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:08.961813 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b6b97b60-a684-499d-ac42-728204bc8683 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:09.321370 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-b6b97b60-a684-499d-ac42-728204bc8683 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:09.350656 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-b6b97b60-a684-499d-ac42-728204bc8683 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:09.364737 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-b6b97b60-a684-499d-ac42-728204bc8683 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:09.367423 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-b6b97b60-a684-499d-ac42-728204bc8683 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1723 microversion: 2.20 time: 0.433415 May 03 21:31:09.369294 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 152/288] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:08 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1723 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 21:31:09.391496 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-261dd1b4-d0bc-437f-b75e-5f92ad3eeef6 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:09.392549 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-261dd1b4-d0bc-437f-b75e-5f92ad3eeef6 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:09.404808 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-261dd1b4-d0bc-437f-b75e-5f92ad3eeef6 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:09.405651 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-261dd1b4-d0bc-437f-b75e-5f92ad3eeef6 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:09.407836 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-261dd1b4-d0bc-437f-b75e-5f92ad3eeef6 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:09.408847 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-261dd1b4-d0bc-437f-b75e-5f92ad3eeef6 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:09.663507 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-261dd1b4-d0bc-437f-b75e-5f92ad3eeef6 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:09.672805 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-261dd1b4-d0bc-437f-b75e-5f92ad3eeef6 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f" status: 200 len: 1300 microversion: 2.1 time: 0.301487 May 03 21:31:09.673404 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 153/289] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:09 2022] GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f => generated 1300 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:09.686253 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-d53e2570-b928-4ef1-b0f9-a0b597a4cfa0 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:09.686919 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-d53e2570-b928-4ef1-b0f9-a0b597a4cfa0 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: 3849d6f2-1dba-4e09-956d-54d873eea387] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:09.695271 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d53e2570-b928-4ef1-b0f9-a0b597a4cfa0 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:09.695834 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d53e2570-b928-4ef1-b0f9-a0b597a4cfa0 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:09.697330 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d53e2570-b928-4ef1-b0f9-a0b597a4cfa0 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:09.697771 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d53e2570-b928-4ef1-b0f9-a0b597a4cfa0 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:09.749547 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-1aa5204f-7eda-48d7-a1ba-9e3295188de3 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:09.760152 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-1aa5204f-7eda-48d7-a1ba-9e3295188de3 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1722 microversion: 2.1 time: 1.099544 May 03 21:31:09.765463 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 137/290] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:08 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1722 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:09.778321 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-d09b1308-8807-40ad-b9dc-9041ef804e67 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:09.779819 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-d09b1308-8807-40ad-b9dc-9041ef804e67 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:09.787688 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d09b1308-8807-40ad-b9dc-9041ef804e67 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:09.788259 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d09b1308-8807-40ad-b9dc-9041ef804e67 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:09.789432 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d09b1308-8807-40ad-b9dc-9041ef804e67 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:09.790074 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d09b1308-8807-40ad-b9dc-9041ef804e67 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:09.995643 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-d53e2570-b928-4ef1-b0f9-a0b597a4cfa0 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:10.014878 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-d53e2570-b928-4ef1-b0f9-a0b597a4cfa0 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387" status: 200 len: 1314 microversion: 2.1 time: 0.338802 May 03 21:31:10.016476 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 154/291] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:09 2022] GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:10.040015 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-d09b1308-8807-40ad-b9dc-9041ef804e67 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:10.052642 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-d09b1308-8807-40ad-b9dc-9041ef804e67 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1314 microversion: 2.1 time: 0.288120 May 03 21:31:10.054252 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 138/292] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:09 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:10.401893 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-f0cc286f-f172-4c54-a6ba-9987a3bbe457 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:10.402522 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-f0cc286f-f172-4c54-a6ba-9987a3bbe457 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:10.409997 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f0cc286f-f172-4c54-a6ba-9987a3bbe457 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:10.410432 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f0cc286f-f172-4c54-a6ba-9987a3bbe457 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:10.411258 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f0cc286f-f172-4c54-a6ba-9987a3bbe457 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:10.411648 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f0cc286f-f172-4c54-a6ba-9987a3bbe457 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:10.720761 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-73996cce-93e6-4482-9f48-6d910e09ce42 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:10.721771 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-73996cce-93e6-4482-9f48-6d910e09ce42 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:10.736896 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-73996cce-93e6-4482-9f48-6d910e09ce42 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:10.736896 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-73996cce-93e6-4482-9f48-6d910e09ce42 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:10.736896 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-73996cce-93e6-4482-9f48-6d910e09ce42 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:10.737747 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-73996cce-93e6-4482-9f48-6d910e09ce42 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:10.802134 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-f0cc286f-f172-4c54-a6ba-9987a3bbe457 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:10.830228 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-f0cc286f-f172-4c54-a6ba-9987a3bbe457 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:10.842904 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-f0cc286f-f172-4c54-a6ba-9987a3bbe457 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:10.844225 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-f0cc286f-f172-4c54-a6ba-9987a3bbe457 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1723 microversion: 2.20 time: 0.452004 May 03 21:31:10.844995 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 155/293] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:10 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1723 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 21:31:10.855413 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-89bb03aa-8b29-4ad7-92f4-3a8754f3a9c7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:10.856672 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-89bb03aa-8b29-4ad7-92f4-3a8754f3a9c7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:10.865294 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-89bb03aa-8b29-4ad7-92f4-3a8754f3a9c7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:10.865913 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-89bb03aa-8b29-4ad7-92f4-3a8754f3a9c7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:10.866803 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-89bb03aa-8b29-4ad7-92f4-3a8754f3a9c7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:10.867343 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-89bb03aa-8b29-4ad7-92f4-3a8754f3a9c7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:11.187570 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-89bb03aa-8b29-4ad7-92f4-3a8754f3a9c7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:11.202866 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-89bb03aa-8b29-4ad7-92f4-3a8754f3a9c7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1722 microversion: 2.1 time: 0.355719 May 03 21:31:11.210646 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 156/294] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:10 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1722 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:11.218409 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-5bbaad70-f052-47b1-8444-2eb4ff540001 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:11.219420 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-5bbaad70-f052-47b1-8444-2eb4ff540001 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: 3849d6f2-1dba-4e09-956d-54d873eea387] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:11.230048 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5bbaad70-f052-47b1-8444-2eb4ff540001 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:11.231331 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5bbaad70-f052-47b1-8444-2eb4ff540001 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:11.232275 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5bbaad70-f052-47b1-8444-2eb4ff540001 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:11.232943 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5bbaad70-f052-47b1-8444-2eb4ff540001 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:11.501229 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-5bbaad70-f052-47b1-8444-2eb4ff540001 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:11.520007 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-5bbaad70-f052-47b1-8444-2eb4ff540001 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387" status: 200 len: 1314 microversion: 2.1 time: 0.313897 May 03 21:31:11.521074 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 157/295] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:11 2022] GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:11.538301 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-60c737e8-5eb7-491b-8b0d-fee4c6bc3819 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:11.539015 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-60c737e8-5eb7-491b-8b0d-fee4c6bc3819 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:11.547970 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-60c737e8-5eb7-491b-8b0d-fee4c6bc3819 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:11.548685 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-60c737e8-5eb7-491b-8b0d-fee4c6bc3819 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:11.549660 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-60c737e8-5eb7-491b-8b0d-fee4c6bc3819 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:11.550103 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-60c737e8-5eb7-491b-8b0d-fee4c6bc3819 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:11.690216 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-73996cce-93e6-4482-9f48-6d910e09ce42 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:11.701887 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-73996cce-93e6-4482-9f48-6d910e09ce42 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f" status: 200 len: 1368 microversion: 2.1 time: 1.011924 May 03 21:31:11.702455 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 139/296] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:10 2022] GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f => generated 1368 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:11.715377 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-60c737e8-5eb7-491b-8b0d-fee4c6bc3819 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:11.724047 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-60c737e8-5eb7-491b-8b0d-fee4c6bc3819 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1302 microversion: 2.1 time: 0.201005 May 03 21:31:11.724635 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 158/297] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:11 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1302 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:11.879684 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-dddd3ec8-646c-485e-a316-5fe7ac5f58be tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:11.880443 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-dddd3ec8-646c-485e-a316-5fe7ac5f58be tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:11.888608 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-dddd3ec8-646c-485e-a316-5fe7ac5f58be tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:11.889103 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-dddd3ec8-646c-485e-a316-5fe7ac5f58be tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:11.889975 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-dddd3ec8-646c-485e-a316-5fe7ac5f58be tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:11.890579 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-dddd3ec8-646c-485e-a316-5fe7ac5f58be tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:12.243221 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-cc1dec8e-ef60-4161-985a-8ffe1e88fa24 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:12.252553 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-cc1dec8e-ef60-4161-985a-8ffe1e88fa24 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:12.277204 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cc1dec8e-ef60-4161-985a-8ffe1e88fa24 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:12.278130 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cc1dec8e-ef60-4161-985a-8ffe1e88fa24 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:12.279964 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cc1dec8e-ef60-4161-985a-8ffe1e88fa24 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:12.281126 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cc1dec8e-ef60-4161-985a-8ffe1e88fa24 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:12.531575 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-dddd3ec8-646c-485e-a316-5fe7ac5f58be tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:12.559062 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-dddd3ec8-646c-485e-a316-5fe7ac5f58be tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:12.573267 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-dddd3ec8-646c-485e-a316-5fe7ac5f58be tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:12.575559 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-dddd3ec8-646c-485e-a316-5fe7ac5f58be tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1723 microversion: 2.20 time: 0.712595 May 03 21:31:12.577182 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 140/298] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:11 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1723 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:31:12.600124 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-41454645-773e-4f97-8bc3-762453c78bcb tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:12.606053 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-41454645-773e-4f97-8bc3-762453c78bcb tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: 3849d6f2-1dba-4e09-956d-54d873eea387] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:12.607397 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-cc1dec8e-ef60-4161-985a-8ffe1e88fa24 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:12.615723 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-41454645-773e-4f97-8bc3-762453c78bcb tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:12.617186 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-41454645-773e-4f97-8bc3-762453c78bcb tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:12.619344 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-41454645-773e-4f97-8bc3-762453c78bcb tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:12.620623 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-41454645-773e-4f97-8bc3-762453c78bcb tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:12.623085 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-cc1dec8e-ef60-4161-985a-8ffe1e88fa24 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1722 microversion: 2.1 time: 0.399810 May 03 21:31:12.624090 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 159/299] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:12 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1722 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:31:12.729150 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-fe4bda55-c692-4c71-865d-84610c2f32a8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:12.729804 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-fe4bda55-c692-4c71-865d-84610c2f32a8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:12.745257 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fe4bda55-c692-4c71-865d-84610c2f32a8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:12.746047 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fe4bda55-c692-4c71-865d-84610c2f32a8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:12.747917 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fe4bda55-c692-4c71-865d-84610c2f32a8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:12.748738 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fe4bda55-c692-4c71-865d-84610c2f32a8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:13.185597 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-fe4bda55-c692-4c71-865d-84610c2f32a8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:13.194394 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-fe4bda55-c692-4c71-865d-84610c2f32a8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f" status: 200 len: 1368 microversion: 2.1 time: 0.479097 May 03 21:31:13.195020 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 160/300] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:12 2022] GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f => generated 1368 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:13.205758 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-040e1aa1-72b4-4c30-9db1-c2f9f80115dd tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:13.206375 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-040e1aa1-72b4-4c30-9db1-c2f9f80115dd tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:13.214960 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-040e1aa1-72b4-4c30-9db1-c2f9f80115dd tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:13.215208 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-040e1aa1-72b4-4c30-9db1-c2f9f80115dd tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:13.216025 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-040e1aa1-72b4-4c30-9db1-c2f9f80115dd tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:13.216708 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-040e1aa1-72b4-4c30-9db1-c2f9f80115dd tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:13.469897 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-040e1aa1-72b4-4c30-9db1-c2f9f80115dd tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:13.482353 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-040e1aa1-72b4-4c30-9db1-c2f9f80115dd tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1370 microversion: 2.1 time: 0.284389 May 03 21:31:13.486137 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 161/301] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:13 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1370 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:13.520714 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-41454645-773e-4f97-8bc3-762453c78bcb tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:13.531755 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-41454645-773e-4f97-8bc3-762453c78bcb tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387" status: 200 len: 1314 microversion: 2.1 time: 0.952718 May 03 21:31:13.542514 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 141/302] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:12 2022] GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387 => generated 1314 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:13.627956 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-efe2585c-c206-4157-87f2-4f53d7a1f6f1 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:13.627956 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-efe2585c-c206-4157-87f2-4f53d7a1f6f1 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:13.647975 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-efe2585c-c206-4157-87f2-4f53d7a1f6f1 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:13.648774 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-efe2585c-c206-4157-87f2-4f53d7a1f6f1 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:13.650083 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-efe2585c-c206-4157-87f2-4f53d7a1f6f1 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:13.650818 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-efe2585c-c206-4157-87f2-4f53d7a1f6f1 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:13.660311 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-e3012fb0-90a3-4763-a597-342634ecf16c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:13.661167 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-e3012fb0-90a3-4763-a597-342634ecf16c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:13.674694 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e3012fb0-90a3-4763-a597-342634ecf16c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:13.676149 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e3012fb0-90a3-4763-a597-342634ecf16c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:13.676991 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e3012fb0-90a3-4763-a597-342634ecf16c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:13.677435 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e3012fb0-90a3-4763-a597-342634ecf16c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:13.917365 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-efe2585c-c206-4157-87f2-4f53d7a1f6f1 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:13.955103 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-efe2585c-c206-4157-87f2-4f53d7a1f6f1 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:13.970414 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-efe2585c-c206-4157-87f2-4f53d7a1f6f1 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:13.972044 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-efe2585c-c206-4157-87f2-4f53d7a1f6f1 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1723 microversion: 2.20 time: 0.362256 May 03 21:31:13.987232 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 162/303] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:13 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1723 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:31:13.987232 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-b2b869f4-e868-49f2-a8fa-035627df1d3d req-993c2b8b-3cab-400a-ad29-3b6873d04beb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b1e6cc5-801c-4aa5-92fa-1f490590cb9f", "tag": "da492c37-8214-4064-8e3b-45911d07e1d8"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:31:13.990932 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:31:13.990932 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:31:14.001468 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-b2b869f4-e868-49f2-a8fa-035627df1d3d req-993c2b8b-3cab-400a-ad29-3b6873d04beb service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:14.001974 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-b2b869f4-e868-49f2-a8fa-035627df1d3d req-993c2b8b-3cab-400a-ad29-3b6873d04beb service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:14.030886 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-b2b869f4-e868-49f2-a8fa-035627df1d3d req-993c2b8b-3cab-400a-ad29-3b6873d04beb service nova] Creating event network-changed:da492c37-8214-4064-8e3b-45911d07e1d8 for instance 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f on hv-cinder-84037 May 03 21:31:14.041145 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-b2b869f4-e868-49f2-a8fa-035627df1d3d req-993c2b8b-3cab-400a-ad29-3b6873d04beb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066187 May 03 21:31:14.042234 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 163/304] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:31:14.220028 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-50e2b9a7-51c7-4f06-b499-409f3c425052 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:14.230912 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-50e2b9a7-51c7-4f06-b499-409f3c425052 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:14.254791 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-50e2b9a7-51c7-4f06-b499-409f3c425052 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:14.255633 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-50e2b9a7-51c7-4f06-b499-409f3c425052 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:14.256864 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-50e2b9a7-51c7-4f06-b499-409f3c425052 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:14.259925 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-50e2b9a7-51c7-4f06-b499-409f3c425052 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:14.303869 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-e3012fb0-90a3-4763-a597-342634ecf16c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:14.334261 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-e3012fb0-90a3-4763-a597-342634ecf16c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1722 microversion: 2.1 time: 0.696547 May 03 21:31:14.335519 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 142/305] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:13 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1722 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:14.512819 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-45b59ce0-8ff8-4fc1-ba27-a0249e925380 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:14.513420 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-45b59ce0-8ff8-4fc1-ba27-a0249e925380 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:14.543222 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-45b59ce0-8ff8-4fc1-ba27-a0249e925380 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:14.544609 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-45b59ce0-8ff8-4fc1-ba27-a0249e925380 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:14.546298 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-45b59ce0-8ff8-4fc1-ba27-a0249e925380 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:14.555398 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-45b59ce0-8ff8-4fc1-ba27-a0249e925380 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:14.689195 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-50e2b9a7-51c7-4f06-b499-409f3c425052 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:14.720339 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-50e2b9a7-51c7-4f06-b499-409f3c425052 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f" status: 200 len: 1368 microversion: 2.1 time: 0.512133 May 03 21:31:14.722303 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 164/306] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:14 2022] GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f => generated 1368 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:14.748953 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-de868e0a-7f5e-4b2a-9898-4625c8ae7f37 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:14.749841 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-de868e0a-7f5e-4b2a-9898-4625c8ae7f37 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: 3849d6f2-1dba-4e09-956d-54d873eea387] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:14.762303 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-de868e0a-7f5e-4b2a-9898-4625c8ae7f37 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:14.762979 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-de868e0a-7f5e-4b2a-9898-4625c8ae7f37 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:14.763802 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-de868e0a-7f5e-4b2a-9898-4625c8ae7f37 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:14.764628 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-de868e0a-7f5e-4b2a-9898-4625c8ae7f37 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:15.085048 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-de868e0a-7f5e-4b2a-9898-4625c8ae7f37 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:15.096658 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-de868e0a-7f5e-4b2a-9898-4625c8ae7f37 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387" status: 200 len: 1314 microversion: 2.1 time: 0.365466 May 03 21:31:15.098141 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 165/307] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:14 2022] GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387 => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:15.109584 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-be25f5df-4497-4c8a-8890-ed29cf938b1d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:15.110206 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-be25f5df-4497-4c8a-8890-ed29cf938b1d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:15.117651 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-be25f5df-4497-4c8a-8890-ed29cf938b1d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:15.118442 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-be25f5df-4497-4c8a-8890-ed29cf938b1d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:15.119527 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-be25f5df-4497-4c8a-8890-ed29cf938b1d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:15.120523 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-be25f5df-4497-4c8a-8890-ed29cf938b1d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:15.506990 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-be25f5df-4497-4c8a-8890-ed29cf938b1d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:15.530633 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-be25f5df-4497-4c8a-8890-ed29cf938b1d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:15.538736 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-be25f5df-4497-4c8a-8890-ed29cf938b1d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:15.540059 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-be25f5df-4497-4c8a-8890-ed29cf938b1d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1723 microversion: 2.20 time: 0.440567 May 03 21:31:15.540780 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 166/308] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:15 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1723 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:31:15.560968 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-5d9aeda6-9f02-4a4b-b73e-7631af1b77fd tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:15.567642 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-45b59ce0-8ff8-4fc1-ba27-a0249e925380 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:15.568136 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-5d9aeda6-9f02-4a4b-b73e-7631af1b77fd tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:15.574248 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5d9aeda6-9f02-4a4b-b73e-7631af1b77fd tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:15.575025 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5d9aeda6-9f02-4a4b-b73e-7631af1b77fd tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:15.575785 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-45b59ce0-8ff8-4fc1-ba27-a0249e925380 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1370 microversion: 2.1 time: 1.081208 May 03 21:31:15.576243 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5d9aeda6-9f02-4a4b-b73e-7631af1b77fd tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:15.576363 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 143/309] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:14 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1370 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:31:15.577029 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5d9aeda6-9f02-4a4b-b73e-7631af1b77fd tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:15.754466 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-3aaf082d-064d-4079-ba0f-c7e22e46175d tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:15.755330 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-3aaf082d-064d-4079-ba0f-c7e22e46175d tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:15.773067 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-3aaf082d-064d-4079-ba0f-c7e22e46175d tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:15.773698 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-3aaf082d-064d-4079-ba0f-c7e22e46175d tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:15.774773 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-3aaf082d-064d-4079-ba0f-c7e22e46175d tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:15.775389 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-3aaf082d-064d-4079-ba0f-c7e22e46175d tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:15.979519 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-5d9aeda6-9f02-4a4b-b73e-7631af1b77fd tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:15.990746 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-5d9aeda6-9f02-4a4b-b73e-7631af1b77fd tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1722 microversion: 2.1 time: 0.448646 May 03 21:31:15.991472 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 167/310] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:15 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1722 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:16.090301 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-43d1bf4d-07d3-4ccc-a416-57dfd75b7bfc req-7bbfe887-7196-4918-a8ae-9d4116eefd03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb2b9b5d-640a-401a-ac60-566b6d8dbc52", "tag": "a2903b13-fffc-4e5f-9a12-4bcb585327dd"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:31:16.105924 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:31:16.105924 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:31:16.125257 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-43d1bf4d-07d3-4ccc-a416-57dfd75b7bfc req-7bbfe887-7196-4918-a8ae-9d4116eefd03 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:16.127329 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-43d1bf4d-07d3-4ccc-a416-57dfd75b7bfc req-7bbfe887-7196-4918-a8ae-9d4116eefd03 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:16.167408 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-43d1bf4d-07d3-4ccc-a416-57dfd75b7bfc req-7bbfe887-7196-4918-a8ae-9d4116eefd03 service nova] Creating event network-changed:a2903b13-fffc-4e5f-9a12-4bcb585327dd for instance cb2b9b5d-640a-401a-ac60-566b6d8dbc52 on hv-cinder-84037 May 03 21:31:16.172418 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-43d1bf4d-07d3-4ccc-a416-57dfd75b7bfc req-7bbfe887-7196-4918-a8ae-9d4116eefd03 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119879 May 03 21:31:16.173590 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 168/311] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:31:16.185647 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-fa19c27a-9f01-4223-9a88-20da89e6331a tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:16.186617 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-fa19c27a-9f01-4223-9a88-20da89e6331a tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: 3849d6f2-1dba-4e09-956d-54d873eea387] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:16.200946 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fa19c27a-9f01-4223-9a88-20da89e6331a tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:16.200946 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fa19c27a-9f01-4223-9a88-20da89e6331a tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:16.201691 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fa19c27a-9f01-4223-9a88-20da89e6331a tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:16.202121 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fa19c27a-9f01-4223-9a88-20da89e6331a tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:16.517473 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-fa19c27a-9f01-4223-9a88-20da89e6331a tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:16.528282 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-fa19c27a-9f01-4223-9a88-20da89e6331a tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387" status: 200 len: 1314 microversion: 2.1 time: 0.353317 May 03 21:31:16.540542 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 169/312] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:16 2022] GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:16.565453 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-b401de1c-8a50-463a-a481-0fb9b1a19e0f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:16.566179 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-b401de1c-8a50-463a-a481-0fb9b1a19e0f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:16.574968 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b401de1c-8a50-463a-a481-0fb9b1a19e0f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:16.574968 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b401de1c-8a50-463a-a481-0fb9b1a19e0f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:16.575895 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b401de1c-8a50-463a-a481-0fb9b1a19e0f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:16.576399 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b401de1c-8a50-463a-a481-0fb9b1a19e0f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:16.651369 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-3aaf082d-064d-4079-ba0f-c7e22e46175d tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:16.660485 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-3aaf082d-064d-4079-ba0f-c7e22e46175d tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f" status: 200 len: 1368 microversion: 2.1 time: 0.917710 May 03 21:31:16.661749 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 144/313] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:15 2022] GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f => generated 1368 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:16.676191 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-34ee8277-8c06-4b85-a512-1e8890f1c194 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:16.677128 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-34ee8277-8c06-4b85-a512-1e8890f1c194 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:16.687045 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-34ee8277-8c06-4b85-a512-1e8890f1c194 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:16.687045 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-34ee8277-8c06-4b85-a512-1e8890f1c194 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:16.687759 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-34ee8277-8c06-4b85-a512-1e8890f1c194 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:16.688345 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-34ee8277-8c06-4b85-a512-1e8890f1c194 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:16.851728 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-b401de1c-8a50-463a-a481-0fb9b1a19e0f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:16.869115 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-b401de1c-8a50-463a-a481-0fb9b1a19e0f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:16.876898 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-b401de1c-8a50-463a-a481-0fb9b1a19e0f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:16.878549 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-b401de1c-8a50-463a-a481-0fb9b1a19e0f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1723 microversion: 2.20 time: 0.323737 May 03 21:31:16.879238 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 170/314] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:16 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1723 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:31:17.016862 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-3938c200-9037-48d5-b25b-81fd1c81eb87 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:17.017714 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-3938c200-9037-48d5-b25b-81fd1c81eb87 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:17.025911 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3938c200-9037-48d5-b25b-81fd1c81eb87 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:17.026642 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3938c200-9037-48d5-b25b-81fd1c81eb87 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:17.027563 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3938c200-9037-48d5-b25b-81fd1c81eb87 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:17.028262 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3938c200-9037-48d5-b25b-81fd1c81eb87 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:17.319916 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-3938c200-9037-48d5-b25b-81fd1c81eb87 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:17.337812 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-3938c200-9037-48d5-b25b-81fd1c81eb87 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1722 microversion: 2.1 time: 0.326258 May 03 21:31:17.337812 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 171/315] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:17 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1722 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:31:17.371447 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-34ee8277-8c06-4b85-a512-1e8890f1c194 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:17.382061 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-34ee8277-8c06-4b85-a512-1e8890f1c194 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1370 microversion: 2.1 time: 0.718847 May 03 21:31:17.382614 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 145/316] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:16 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1370 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:17.564935 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-9586f155-e9b1-487b-848f-3b5f47e76227 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:17.565954 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-9586f155-e9b1-487b-848f-3b5f47e76227 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: 3849d6f2-1dba-4e09-956d-54d873eea387] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:17.574411 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9586f155-e9b1-487b-848f-3b5f47e76227 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:17.574853 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9586f155-e9b1-487b-848f-3b5f47e76227 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:17.575625 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9586f155-e9b1-487b-848f-3b5f47e76227 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:17.576050 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9586f155-e9b1-487b-848f-3b5f47e76227 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:17.687168 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-fcb88b82-64fd-4b9b-954b-17dac5cac4b3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:17.687776 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-fcb88b82-64fd-4b9b-954b-17dac5cac4b3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:17.695836 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fcb88b82-64fd-4b9b-954b-17dac5cac4b3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:17.696292 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fcb88b82-64fd-4b9b-954b-17dac5cac4b3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:17.713426 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fcb88b82-64fd-4b9b-954b-17dac5cac4b3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:17.713958 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fcb88b82-64fd-4b9b-954b-17dac5cac4b3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:17.843592 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-9586f155-e9b1-487b-848f-3b5f47e76227 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:17.853241 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-9586f155-e9b1-487b-848f-3b5f47e76227 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387" status: 200 len: 1314 microversion: 2.1 time: 0.305865 May 03 21:31:17.853802 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 172/317] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:17 2022] GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:17.913551 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-f2de3a6b-9c4b-47ab-aec2-6b7ce021c2e7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:17.914531 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-f2de3a6b-9c4b-47ab-aec2-6b7ce021c2e7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:17.926556 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f2de3a6b-9c4b-47ab-aec2-6b7ce021c2e7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:17.927002 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f2de3a6b-9c4b-47ab-aec2-6b7ce021c2e7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:17.928031 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f2de3a6b-9c4b-47ab-aec2-6b7ce021c2e7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:17.928698 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f2de3a6b-9c4b-47ab-aec2-6b7ce021c2e7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:18.037393 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-fcb88b82-64fd-4b9b-954b-17dac5cac4b3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:18.046777 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-fcb88b82-64fd-4b9b-954b-17dac5cac4b3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f" status: 200 len: 1368 microversion: 2.1 time: 0.370967 May 03 21:31:18.047327 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 146/318] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:17 2022] GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f => generated 1368 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:31:18.225452 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-f2de3a6b-9c4b-47ab-aec2-6b7ce021c2e7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:18.239722 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-f2de3a6b-9c4b-47ab-aec2-6b7ce021c2e7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:18.246894 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-f2de3a6b-9c4b-47ab-aec2-6b7ce021c2e7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:18.248035 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-f2de3a6b-9c4b-47ab-aec2-6b7ce021c2e7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1723 microversion: 2.20 time: 0.354737 May 03 21:31:18.248604 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 173/319] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:17 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1723 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 21:31:18.357387 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-90b8fca9-6ccb-4f45-bfb7-c50b98c69c31 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:18.357992 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-90b8fca9-6ccb-4f45-bfb7-c50b98c69c31 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:18.366289 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-90b8fca9-6ccb-4f45-bfb7-c50b98c69c31 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:18.366289 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-90b8fca9-6ccb-4f45-bfb7-c50b98c69c31 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:18.366851 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-90b8fca9-6ccb-4f45-bfb7-c50b98c69c31 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:18.367287 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-90b8fca9-6ccb-4f45-bfb7-c50b98c69c31 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:18.406151 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-f71310e7-8100-4d76-a0fa-ef90191774e8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:18.407285 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-f71310e7-8100-4d76-a0fa-ef90191774e8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:18.418007 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f71310e7-8100-4d76-a0fa-ef90191774e8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:18.418923 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f71310e7-8100-4d76-a0fa-ef90191774e8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:18.419877 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f71310e7-8100-4d76-a0fa-ef90191774e8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:18.420328 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f71310e7-8100-4d76-a0fa-ef90191774e8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:18.677284 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-f71310e7-8100-4d76-a0fa-ef90191774e8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:18.689239 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-f71310e7-8100-4d76-a0fa-ef90191774e8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1370 microversion: 2.1 time: 0.293474 May 03 21:31:18.691378 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 174/320] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:18 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1370 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:31:18.711907 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-90b8fca9-6ccb-4f45-bfb7-c50b98c69c31 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:18.721654 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-90b8fca9-6ccb-4f45-bfb7-c50b98c69c31 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1722 microversion: 2.1 time: 0.374541 May 03 21:31:18.722156 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 147/321] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:18 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1722 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:18.878398 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-6bfff495-6202-4ec8-ba2e-e19b5557f021 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:18.879058 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-6bfff495-6202-4ec8-ba2e-e19b5557f021 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: 3849d6f2-1dba-4e09-956d-54d873eea387] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:18.886906 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6bfff495-6202-4ec8-ba2e-e19b5557f021 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:18.887432 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6bfff495-6202-4ec8-ba2e-e19b5557f021 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:18.888246 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6bfff495-6202-4ec8-ba2e-e19b5557f021 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:18.888712 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6bfff495-6202-4ec8-ba2e-e19b5557f021 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:19.079020 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-dc3ac3ad-e1f7-4358-a562-3f06d79999d8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:19.079641 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-dc3ac3ad-e1f7-4358-a562-3f06d79999d8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:19.087670 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-dc3ac3ad-e1f7-4358-a562-3f06d79999d8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:19.088412 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-dc3ac3ad-e1f7-4358-a562-3f06d79999d8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:19.089499 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-dc3ac3ad-e1f7-4358-a562-3f06d79999d8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:19.090149 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-dc3ac3ad-e1f7-4358-a562-3f06d79999d8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:19.132612 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-6bfff495-6202-4ec8-ba2e-e19b5557f021 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:19.142537 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-6bfff495-6202-4ec8-ba2e-e19b5557f021 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387" status: 200 len: 1314 microversion: 2.1 time: 0.274362 May 03 21:31:19.143311 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 175/322] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:18 2022] GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:31:19.274349 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-f4cd84e1-eb4b-4a95-b15c-1ecfdaf33085 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:19.277255 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-f4cd84e1-eb4b-4a95-b15c-1ecfdaf33085 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:19.285439 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f4cd84e1-eb4b-4a95-b15c-1ecfdaf33085 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:19.285897 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f4cd84e1-eb4b-4a95-b15c-1ecfdaf33085 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:19.286689 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f4cd84e1-eb4b-4a95-b15c-1ecfdaf33085 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:19.287121 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f4cd84e1-eb4b-4a95-b15c-1ecfdaf33085 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:19.339780 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-dc3ac3ad-e1f7-4358-a562-3f06d79999d8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:19.352505 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-dc3ac3ad-e1f7-4358-a562-3f06d79999d8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f" status: 200 len: 1368 microversion: 2.1 time: 0.283725 May 03 21:31:19.353072 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 148/323] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:19 2022] GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f => generated 1368 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:19.546416 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-f4cd84e1-eb4b-4a95-b15c-1ecfdaf33085 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:19.562185 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-f4cd84e1-eb4b-4a95-b15c-1ecfdaf33085 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:19.568285 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-f4cd84e1-eb4b-4a95-b15c-1ecfdaf33085 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:19.569431 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-f4cd84e1-eb4b-4a95-b15c-1ecfdaf33085 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1723 microversion: 2.20 time: 0.305952 May 03 21:31:19.569962 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 176/324] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:19 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1723 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 21:31:19.719532 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-3b3dfdc3-87a8-4574-b7af-0b6d2ff11fa0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:19.720983 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-3b3dfdc3-87a8-4574-b7af-0b6d2ff11fa0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:19.730748 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-3b3dfdc3-87a8-4574-b7af-0b6d2ff11fa0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:19.731266 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-3b3dfdc3-87a8-4574-b7af-0b6d2ff11fa0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:19.732844 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-3b3dfdc3-87a8-4574-b7af-0b6d2ff11fa0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:19.735210 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-3b3dfdc3-87a8-4574-b7af-0b6d2ff11fa0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:19.756099 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-df6889eb-26d4-49af-a0a8-c92b8699a1d1 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:19.756948 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-df6889eb-26d4-49af-a0a8-c92b8699a1d1 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:19.768286 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-df6889eb-26d4-49af-a0a8-c92b8699a1d1 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:19.768766 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-df6889eb-26d4-49af-a0a8-c92b8699a1d1 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:19.769560 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-df6889eb-26d4-49af-a0a8-c92b8699a1d1 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:19.769995 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-df6889eb-26d4-49af-a0a8-c92b8699a1d1 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:19.964134 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-3b3dfdc3-87a8-4574-b7af-0b6d2ff11fa0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:19.972716 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-3b3dfdc3-87a8-4574-b7af-0b6d2ff11fa0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1370 microversion: 2.1 time: 0.267345 May 03 21:31:19.973257 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 149/325] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:19 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1370 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:19.984326 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-edc9df82-9754-4be7-93c7-ce16dcec206e req-b9d87efe-541c-4f6c-9a39-efc49075a467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3849d6f2-1dba-4e09-956d-54d873eea387", "name": "network-vif-plugged", "status": "completed", "tag": "ee0150a2-32c4-464b-8988-0efae2a38c5c"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:31:19.990977 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:31:19.990977 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:31:20.000726 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-edc9df82-9754-4be7-93c7-ce16dcec206e req-b9d87efe-541c-4f6c-9a39-efc49075a467 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:20.001306 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-edc9df82-9754-4be7-93c7-ce16dcec206e req-b9d87efe-541c-4f6c-9a39-efc49075a467 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:20.007977 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-df6889eb-26d4-49af-a0a8-c92b8699a1d1 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:20.018282 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-df6889eb-26d4-49af-a0a8-c92b8699a1d1 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1722 microversion: 2.1 time: 0.281528 May 03 21:31:20.018934 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 177/326] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:19 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1722 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:31:20.019164 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-edc9df82-9754-4be7-93c7-ce16dcec206e req-b9d87efe-541c-4f6c-9a39-efc49075a467 service nova] Creating event network-vif-plugged:ee0150a2-32c4-464b-8988-0efae2a38c5c for instance 3849d6f2-1dba-4e09-956d-54d873eea387 on hv-cinder-84037 May 03 21:31:20.024379 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-edc9df82-9754-4be7-93c7-ce16dcec206e req-b9d87efe-541c-4f6c-9a39-efc49075a467 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049790 May 03 21:31:20.025277 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 150/327] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:31:20.168066 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-8e85e69c-0c38-4def-8468-f3d37aae20f4 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:20.168705 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-8e85e69c-0c38-4def-8468-f3d37aae20f4 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: 3849d6f2-1dba-4e09-956d-54d873eea387] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:20.176894 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8e85e69c-0c38-4def-8468-f3d37aae20f4 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:20.176894 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8e85e69c-0c38-4def-8468-f3d37aae20f4 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:20.177323 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8e85e69c-0c38-4def-8468-f3d37aae20f4 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:20.177744 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8e85e69c-0c38-4def-8468-f3d37aae20f4 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:20.380940 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-5d8971e9-c75f-4696-80cc-85bc1f9ae923 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:20.382051 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-5d8971e9-c75f-4696-80cc-85bc1f9ae923 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:20.390253 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5d8971e9-c75f-4696-80cc-85bc1f9ae923 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:20.390952 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5d8971e9-c75f-4696-80cc-85bc1f9ae923 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:20.391887 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5d8971e9-c75f-4696-80cc-85bc1f9ae923 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:20.392539 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5d8971e9-c75f-4696-80cc-85bc1f9ae923 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:20.418869 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-8e85e69c-0c38-4def-8468-f3d37aae20f4 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:20.427246 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-8e85e69c-0c38-4def-8468-f3d37aae20f4 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387" status: 200 len: 1314 microversion: 2.1 time: 0.269108 May 03 21:31:20.434317 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 178/328] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:20 2022] GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:20.594093 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-a0699f5f-c50e-41d0-bb37-1932a50487e4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:20.594696 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-a0699f5f-c50e-41d0-bb37-1932a50487e4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:20.605254 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a0699f5f-c50e-41d0-bb37-1932a50487e4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:20.605254 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a0699f5f-c50e-41d0-bb37-1932a50487e4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:20.605254 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a0699f5f-c50e-41d0-bb37-1932a50487e4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:20.605254 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a0699f5f-c50e-41d0-bb37-1932a50487e4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:20.854287 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-a0699f5f-c50e-41d0-bb37-1932a50487e4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:20.873070 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-a0699f5f-c50e-41d0-bb37-1932a50487e4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:20.879631 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-a0699f5f-c50e-41d0-bb37-1932a50487e4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:20.881062 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-a0699f5f-c50e-41d0-bb37-1932a50487e4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1723 microversion: 2.20 time: 0.297055 May 03 21:31:20.882415 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 179/329] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:20 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1723 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 21:31:21.006377 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-5d8971e9-c75f-4696-80cc-85bc1f9ae923 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:21.013412 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-3723baaa-a7cf-4bd2-9c8e-bedea37bc601 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:21.019832 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-3723baaa-a7cf-4bd2-9c8e-bedea37bc601 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:21.020094 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-5d8971e9-c75f-4696-80cc-85bc1f9ae923 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f" status: 200 len: 1368 microversion: 2.1 time: 0.647262 May 03 21:31:21.020094 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 151/330] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:20 2022] GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f => generated 1368 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:21.023226 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3723baaa-a7cf-4bd2-9c8e-bedea37bc601 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:21.023883 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3723baaa-a7cf-4bd2-9c8e-bedea37bc601 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:21.037234 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3723baaa-a7cf-4bd2-9c8e-bedea37bc601 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:21.037688 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3723baaa-a7cf-4bd2-9c8e-bedea37bc601 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:21.044503 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-5d43989f-f888-48d2-9b9b-0b2e80efbe21 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:21.045814 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-5d43989f-f888-48d2-9b9b-0b2e80efbe21 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:21.053964 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5d43989f-f888-48d2-9b9b-0b2e80efbe21 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:21.054772 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5d43989f-f888-48d2-9b9b-0b2e80efbe21 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:21.056769 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5d43989f-f888-48d2-9b9b-0b2e80efbe21 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:21.057396 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5d43989f-f888-48d2-9b9b-0b2e80efbe21 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:21.356543 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-3723baaa-a7cf-4bd2-9c8e-bedea37bc601 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:21.363377 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-3723baaa-a7cf-4bd2-9c8e-bedea37bc601 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1370 microversion: 2.1 time: 0.375771 May 03 21:31:21.364007 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 180/331] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:20 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1370 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:31:21.453228 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-7bbdb24f-bf68-42e0-ae14-04ed165a5d57 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:21.463885 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-7bbdb24f-bf68-42e0-ae14-04ed165a5d57 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: 3849d6f2-1dba-4e09-956d-54d873eea387] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:21.463885 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7bbdb24f-bf68-42e0-ae14-04ed165a5d57 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:21.463885 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7bbdb24f-bf68-42e0-ae14-04ed165a5d57 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:21.464756 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7bbdb24f-bf68-42e0-ae14-04ed165a5d57 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:21.465753 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7bbdb24f-bf68-42e0-ae14-04ed165a5d57 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:21.608020 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-5d43989f-f888-48d2-9b9b-0b2e80efbe21 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:21.616935 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-5d43989f-f888-48d2-9b9b-0b2e80efbe21 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1722 microversion: 2.1 time: 0.583905 May 03 21:31:21.617467 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 152/332] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:21 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1722 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:31:21.774691 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-7bbdb24f-bf68-42e0-ae14-04ed165a5d57 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:21.784077 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-7bbdb24f-bf68-42e0-ae14-04ed165a5d57 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387" status: 200 len: 1314 microversion: 2.1 time: 0.341078 May 03 21:31:21.793535 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 181/333] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:21 2022] GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387 => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:31:21.907756 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-5c7c280a-b976-4d35-b5bb-cd81d8c49ff5 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:21.908691 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-5c7c280a-b976-4d35-b5bb-cd81d8c49ff5 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:21.916971 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5c7c280a-b976-4d35-b5bb-cd81d8c49ff5 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:21.917345 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5c7c280a-b976-4d35-b5bb-cd81d8c49ff5 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:21.918181 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5c7c280a-b976-4d35-b5bb-cd81d8c49ff5 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:21.918535 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5c7c280a-b976-4d35-b5bb-cd81d8c49ff5 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:22.046650 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-f1c2b5d4-f1b7-44f8-97d7-f4a335b7a7e8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:22.047167 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-f1c2b5d4-f1b7-44f8-97d7-f4a335b7a7e8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:22.078353 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f1c2b5d4-f1b7-44f8-97d7-f4a335b7a7e8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:22.078353 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f1c2b5d4-f1b7-44f8-97d7-f4a335b7a7e8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:22.078353 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f1c2b5d4-f1b7-44f8-97d7-f4a335b7a7e8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:22.078353 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f1c2b5d4-f1b7-44f8-97d7-f4a335b7a7e8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:22.214733 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-5c7c280a-b976-4d35-b5bb-cd81d8c49ff5 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:22.230297 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-5c7c280a-b976-4d35-b5bb-cd81d8c49ff5 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:22.236793 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-5c7c280a-b976-4d35-b5bb-cd81d8c49ff5 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:22.242519 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-5c7c280a-b976-4d35-b5bb-cd81d8c49ff5 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1723 microversion: 2.20 time: 0.340981 May 03 21:31:22.242519 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 153/334] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:21 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1723 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:31:22.320189 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-f1c2b5d4-f1b7-44f8-97d7-f4a335b7a7e8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:22.329283 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-f1c2b5d4-f1b7-44f8-97d7-f4a335b7a7e8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f" status: 200 len: 1368 microversion: 2.1 time: 0.293076 May 03 21:31:22.335390 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 182/335] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:22 2022] GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f => generated 1368 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:22.392301 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-5d22c05d-f1d1-480a-b276-c297b966fcf1 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:22.393092 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-5d22c05d-f1d1-480a-b276-c297b966fcf1 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:22.415945 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5d22c05d-f1d1-480a-b276-c297b966fcf1 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:22.416742 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5d22c05d-f1d1-480a-b276-c297b966fcf1 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:22.417749 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5d22c05d-f1d1-480a-b276-c297b966fcf1 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:22.418178 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5d22c05d-f1d1-480a-b276-c297b966fcf1 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:22.652984 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-c0028104-cb19-4c21-817b-72ba51b2e383 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:22.653537 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-c0028104-cb19-4c21-817b-72ba51b2e383 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:22.667117 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c0028104-cb19-4c21-817b-72ba51b2e383 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:22.667878 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c0028104-cb19-4c21-817b-72ba51b2e383 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:22.669263 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c0028104-cb19-4c21-817b-72ba51b2e383 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:22.669760 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c0028104-cb19-4c21-817b-72ba51b2e383 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:22.691595 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-5d22c05d-f1d1-480a-b276-c297b966fcf1 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:22.701182 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-5d22c05d-f1d1-480a-b276-c297b966fcf1 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1370 microversion: 2.1 time: 0.318893 May 03 21:31:22.704415 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 154/336] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:22 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1370 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:22.809437 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-00d4d1f6-2909-4903-8cbf-11e77c646133 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:22.810153 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-00d4d1f6-2909-4903-8cbf-11e77c646133 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: 3849d6f2-1dba-4e09-956d-54d873eea387] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:22.818593 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-00d4d1f6-2909-4903-8cbf-11e77c646133 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:22.824875 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-00d4d1f6-2909-4903-8cbf-11e77c646133 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:22.826642 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-00d4d1f6-2909-4903-8cbf-11e77c646133 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:22.826814 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-00d4d1f6-2909-4903-8cbf-11e77c646133 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:22.941019 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-c0028104-cb19-4c21-817b-72ba51b2e383 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:22.953673 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-c0028104-cb19-4c21-817b-72ba51b2e383 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1722 microversion: 2.1 time: 0.321631 May 03 21:31:22.960273 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 183/337] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:22 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1722 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:31:23.077936 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-00d4d1f6-2909-4903-8cbf-11e77c646133 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:23.093618 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-00d4d1f6-2909-4903-8cbf-11e77c646133 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387" status: 200 len: 1314 microversion: 2.1 time: 0.294427 May 03 21:31:23.110433 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 155/338] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:22 2022] GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:31:23.266306 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-d62f9f23-de91-4847-8265-e26bae579e47 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:23.266936 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-d62f9f23-de91-4847-8265-e26bae579e47 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:23.274445 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d62f9f23-de91-4847-8265-e26bae579e47 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:23.274903 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d62f9f23-de91-4847-8265-e26bae579e47 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:23.275687 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d62f9f23-de91-4847-8265-e26bae579e47 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:23.276187 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d62f9f23-de91-4847-8265-e26bae579e47 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:23.354454 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-428e04e8-7ebb-4c9e-a46f-2b1b4a473dac tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:23.355077 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-428e04e8-7ebb-4c9e-a46f-2b1b4a473dac tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:23.362698 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-428e04e8-7ebb-4c9e-a46f-2b1b4a473dac tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:23.363901 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-428e04e8-7ebb-4c9e-a46f-2b1b4a473dac tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:23.365054 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-428e04e8-7ebb-4c9e-a46f-2b1b4a473dac tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:23.365836 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-428e04e8-7ebb-4c9e-a46f-2b1b4a473dac tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:23.573889 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-d62f9f23-de91-4847-8265-e26bae579e47 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:23.593048 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-d62f9f23-de91-4847-8265-e26bae579e47 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:23.606667 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-d62f9f23-de91-4847-8265-e26bae579e47 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:23.608339 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-d62f9f23-de91-4847-8265-e26bae579e47 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1744 microversion: 2.20 time: 0.353154 May 03 21:31:23.608994 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 184/339] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:23 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1744 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:31:23.733735 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-7d6f008e-bad7-4c0d-b607-ae145e3cfed2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:23.734387 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-7d6f008e-bad7-4c0d-b607-ae145e3cfed2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:23.743332 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7d6f008e-bad7-4c0d-b607-ae145e3cfed2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:23.745386 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7d6f008e-bad7-4c0d-b607-ae145e3cfed2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:23.745386 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7d6f008e-bad7-4c0d-b607-ae145e3cfed2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:23.745788 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7d6f008e-bad7-4c0d-b607-ae145e3cfed2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:23.835445 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-428e04e8-7ebb-4c9e-a46f-2b1b4a473dac tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:23.845792 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-428e04e8-7ebb-4c9e-a46f-2b1b4a473dac tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f" status: 200 len: 1368 microversion: 2.1 time: 0.502021 May 03 21:31:23.846771 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 156/340] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:23 2022] GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f => generated 1368 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:31:23.976553 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-dfa0f55a-374e-4581-b26b-e2a527655446 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:23.977578 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-dfa0f55a-374e-4581-b26b-e2a527655446 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:23.988202 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-dfa0f55a-374e-4581-b26b-e2a527655446 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:23.988202 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-dfa0f55a-374e-4581-b26b-e2a527655446 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:23.988202 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-dfa0f55a-374e-4581-b26b-e2a527655446 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:23.988202 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-dfa0f55a-374e-4581-b26b-e2a527655446 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:23.991722 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-7d6f008e-bad7-4c0d-b607-ae145e3cfed2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:24.001257 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-7d6f008e-bad7-4c0d-b607-ae145e3cfed2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1370 microversion: 2.1 time: 0.284609 May 03 21:31:24.002195 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 185/341] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:23 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1370 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:24.127418 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-afc6fc5e-7799-4673-960e-6c9263dbf220 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:24.128539 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-afc6fc5e-7799-4673-960e-6c9263dbf220 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: 3849d6f2-1dba-4e09-956d-54d873eea387] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:24.142028 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-afc6fc5e-7799-4673-960e-6c9263dbf220 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:24.142621 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-afc6fc5e-7799-4673-960e-6c9263dbf220 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:24.143529 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-afc6fc5e-7799-4673-960e-6c9263dbf220 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:24.144115 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-afc6fc5e-7799-4673-960e-6c9263dbf220 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:24.224526 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-dfa0f55a-374e-4581-b26b-e2a527655446 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:24.235126 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-dfa0f55a-374e-4581-b26b-e2a527655446 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1722 microversion: 2.1 time: 0.267766 May 03 21:31:24.236018 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 157/342] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:23 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1722 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:24.379516 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-afc6fc5e-7799-4673-960e-6c9263dbf220 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:24.388711 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-afc6fc5e-7799-4673-960e-6c9263dbf220 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387" status: 200 len: 1497 microversion: 2.1 time: 0.273920 May 03 21:31:24.389287 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 186/343] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:24 2022] GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387 => generated 1497 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:31:24.634077 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-51a25942-6250-4e4f-b969-de1160aa4125 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:24.634722 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-51a25942-6250-4e4f-b969-de1160aa4125 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:24.642668 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-51a25942-6250-4e4f-b969-de1160aa4125 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:24.643114 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-51a25942-6250-4e4f-b969-de1160aa4125 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:24.643906 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-51a25942-6250-4e4f-b969-de1160aa4125 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:24.644393 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-51a25942-6250-4e4f-b969-de1160aa4125 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:24.874381 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-51a25942-6250-4e4f-b969-de1160aa4125 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:24.881487 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-c229e37c-cd6a-468b-9186-26f047846b10 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:24.882112 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-c229e37c-cd6a-468b-9186-26f047846b10 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:24.891111 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c229e37c-cd6a-468b-9186-26f047846b10 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:24.893936 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c229e37c-cd6a-468b-9186-26f047846b10 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:24.894211 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-51a25942-6250-4e4f-b969-de1160aa4125 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:24.894394 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c229e37c-cd6a-468b-9186-26f047846b10 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:24.894394 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c229e37c-cd6a-468b-9186-26f047846b10 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:24.898616 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-51a25942-6250-4e4f-b969-de1160aa4125 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:24.900332 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-51a25942-6250-4e4f-b969-de1160aa4125 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1744 microversion: 2.20 time: 0.276654 May 03 21:31:24.900894 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 158/344] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:24 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1744 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:31:25.026353 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-78f48ab1-391f-4715-b52f-f7d3bef358ad tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:25.026974 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-78f48ab1-391f-4715-b52f-f7d3bef358ad tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:25.035470 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-78f48ab1-391f-4715-b52f-f7d3bef358ad tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:25.035915 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-78f48ab1-391f-4715-b52f-f7d3bef358ad tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:25.036724 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-78f48ab1-391f-4715-b52f-f7d3bef358ad tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:25.037151 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-78f48ab1-391f-4715-b52f-f7d3bef358ad tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:25.120894 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-c229e37c-cd6a-468b-9186-26f047846b10 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:25.129638 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-c229e37c-cd6a-468b-9186-26f047846b10 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f" status: 200 len: 1368 microversion: 2.1 time: 0.258451 May 03 21:31:25.130174 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 187/345] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:24 2022] GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f => generated 1368 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:31:25.259804 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-78f48ab1-391f-4715-b52f-f7d3bef358ad tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:25.261578 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-a44ca538-9868-49bd-931b-8392a3387ce9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:25.262204 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-a44ca538-9868-49bd-931b-8392a3387ce9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:25.269698 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-78f48ab1-391f-4715-b52f-f7d3bef358ad tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1370 microversion: 2.1 time: 0.254210 May 03 21:31:25.280816 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 159/346] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:25 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1370 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:25.281435 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a44ca538-9868-49bd-931b-8392a3387ce9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:25.281435 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a44ca538-9868-49bd-931b-8392a3387ce9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:25.281435 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a44ca538-9868-49bd-931b-8392a3387ce9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:25.281435 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a44ca538-9868-49bd-931b-8392a3387ce9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:25.513400 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-a44ca538-9868-49bd-931b-8392a3387ce9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:25.522304 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-a44ca538-9868-49bd-931b-8392a3387ce9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1722 microversion: 2.1 time: 0.271851 May 03 21:31:25.522878 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 188/347] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:25 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1722 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:31:25.925995 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-f2a1f7d4-eac2-40f5-8e6b-b49d287774e4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:25.926606 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-f2a1f7d4-eac2-40f5-8e6b-b49d287774e4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:25.935238 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f2a1f7d4-eac2-40f5-8e6b-b49d287774e4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:25.935608 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f2a1f7d4-eac2-40f5-8e6b-b49d287774e4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:25.936379 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f2a1f7d4-eac2-40f5-8e6b-b49d287774e4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:25.936834 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f2a1f7d4-eac2-40f5-8e6b-b49d287774e4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:26.151823 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-ded4f126-70a9-4597-b503-dcaa2a5ecc50 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:26.152456 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-ded4f126-70a9-4597-b503-dcaa2a5ecc50 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:26.153760 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-f2a1f7d4-eac2-40f5-8e6b-b49d287774e4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:26.160125 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ded4f126-70a9-4597-b503-dcaa2a5ecc50 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:26.160617 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ded4f126-70a9-4597-b503-dcaa2a5ecc50 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:26.161400 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ded4f126-70a9-4597-b503-dcaa2a5ecc50 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:26.161832 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ded4f126-70a9-4597-b503-dcaa2a5ecc50 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:26.168538 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-f2a1f7d4-eac2-40f5-8e6b-b49d287774e4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:26.174759 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-f2a1f7d4-eac2-40f5-8e6b-b49d287774e4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:26.175884 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-f2a1f7d4-eac2-40f5-8e6b-b49d287774e4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1744 microversion: 2.20 time: 0.260308 May 03 21:31:26.176406 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 160/348] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:25 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1744 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:31:26.297121 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-7a27bb32-e46c-40fa-8e72-b5e45a0ef9a0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:26.298320 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-7a27bb32-e46c-40fa-8e72-b5e45a0ef9a0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:26.306000 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7a27bb32-e46c-40fa-8e72-b5e45a0ef9a0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:26.306461 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7a27bb32-e46c-40fa-8e72-b5e45a0ef9a0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:26.307411 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7a27bb32-e46c-40fa-8e72-b5e45a0ef9a0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:26.307852 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7a27bb32-e46c-40fa-8e72-b5e45a0ef9a0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:26.401522 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-ded4f126-70a9-4597-b503-dcaa2a5ecc50 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:26.412752 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-ded4f126-70a9-4597-b503-dcaa2a5ecc50 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f" status: 200 len: 1368 microversion: 2.1 time: 0.270315 May 03 21:31:26.413952 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 189/349] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:26 2022] GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f => generated 1368 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:31:26.546505 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-31d5891e-f74c-460a-b808-efae89bbcca5 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:26.547116 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-31d5891e-f74c-460a-b808-efae89bbcca5 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:26.554835 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-31d5891e-f74c-460a-b808-efae89bbcca5 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:26.555892 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-31d5891e-f74c-460a-b808-efae89bbcca5 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:26.556627 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-31d5891e-f74c-460a-b808-efae89bbcca5 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:26.560738 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-31d5891e-f74c-460a-b808-efae89bbcca5 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:26.560863 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-7a27bb32-e46c-40fa-8e72-b5e45a0ef9a0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:26.577208 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-7a27bb32-e46c-40fa-8e72-b5e45a0ef9a0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1370 microversion: 2.1 time: 0.290220 May 03 21:31:26.587702 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 161/350] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:26 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1370 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:31:26.810416 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-31d5891e-f74c-460a-b808-efae89bbcca5 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:26.821898 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-31d5891e-f74c-460a-b808-efae89bbcca5 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1722 microversion: 2.1 time: 0.284461 May 03 21:31:26.822739 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 190/351] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:26 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1722 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:31:27.202532 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-c344d196-67db-4d3d-be58-828780d36ba0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:27.210521 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-c344d196-67db-4d3d-be58-828780d36ba0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:27.223034 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c344d196-67db-4d3d-be58-828780d36ba0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:27.223832 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c344d196-67db-4d3d-be58-828780d36ba0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:27.224943 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c344d196-67db-4d3d-be58-828780d36ba0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:27.225376 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c344d196-67db-4d3d-be58-828780d36ba0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:27.448763 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-28c8f44e-70a0-477a-ab0b-a5a0023bbcda tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:27.449605 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-28c8f44e-70a0-477a-ab0b-a5a0023bbcda tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:27.469885 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-28c8f44e-70a0-477a-ab0b-a5a0023bbcda tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:27.474118 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-28c8f44e-70a0-477a-ab0b-a5a0023bbcda tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:27.474118 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-28c8f44e-70a0-477a-ab0b-a5a0023bbcda tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:27.474118 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-28c8f44e-70a0-477a-ab0b-a5a0023bbcda tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:27.660745 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-c344d196-67db-4d3d-be58-828780d36ba0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:27.680521 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-c344d196-67db-4d3d-be58-828780d36ba0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:27.690066 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-c344d196-67db-4d3d-be58-828780d36ba0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:27.691872 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-c344d196-67db-4d3d-be58-828780d36ba0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1744 microversion: 2.20 time: 0.500253 May 03 21:31:27.694809 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 162/352] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:27 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1744 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:31:27.709581 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-db3c4a1d-96c1-4559-8cf3-f71f15ed52dd tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:27.710216 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-db3c4a1d-96c1-4559-8cf3-f71f15ed52dd tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:27.726561 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-db3c4a1d-96c1-4559-8cf3-f71f15ed52dd tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:27.729556 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-db3c4a1d-96c1-4559-8cf3-f71f15ed52dd tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:27.730869 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-db3c4a1d-96c1-4559-8cf3-f71f15ed52dd tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:27.732532 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-db3c4a1d-96c1-4559-8cf3-f71f15ed52dd tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:27.872638 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-28c8f44e-70a0-477a-ab0b-a5a0023bbcda tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:27.890335 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-28c8f44e-70a0-477a-ab0b-a5a0023bbcda tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f" status: 200 len: 1368 microversion: 2.1 time: 0.461885 May 03 21:31:27.897425 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 191/353] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:27 2022] GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f => generated 1368 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:31:27.919106 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-99beaf3d-7c29-4f93-be7a-0995778eb4fa tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:27.920109 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-99beaf3d-7c29-4f93-be7a-0995778eb4fa tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:27.927746 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-99beaf3d-7c29-4f93-be7a-0995778eb4fa tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:27.928192 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-99beaf3d-7c29-4f93-be7a-0995778eb4fa tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:27.929008 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-99beaf3d-7c29-4f93-be7a-0995778eb4fa tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:27.929439 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-99beaf3d-7c29-4f93-be7a-0995778eb4fa tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:28.279265 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-db3c4a1d-96c1-4559-8cf3-f71f15ed52dd tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:28.280310 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-99beaf3d-7c29-4f93-be7a-0995778eb4fa tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:28.301951 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-db3c4a1d-96c1-4559-8cf3-f71f15ed52dd tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1370 microversion: 2.1 time: 0.606836 May 03 21:31:28.303018 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 163/354] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:27 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1370 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:28.308066 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-99beaf3d-7c29-4f93-be7a-0995778eb4fa tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1722 microversion: 2.1 time: 0.408822 May 03 21:31:28.328815 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 192/355] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:27 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1722 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:28.724078 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-ddd276d2-2ec8-43df-89ec-8f4d5365460a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:28.724764 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-ddd276d2-2ec8-43df-89ec-8f4d5365460a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:28.734572 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ddd276d2-2ec8-43df-89ec-8f4d5365460a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:28.735014 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ddd276d2-2ec8-43df-89ec-8f4d5365460a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:28.735960 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ddd276d2-2ec8-43df-89ec-8f4d5365460a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:28.736585 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ddd276d2-2ec8-43df-89ec-8f4d5365460a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:28.842416 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-3906e169-3efc-4372-8885-075e9f0c1005 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:28.843976 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-3906e169-3efc-4372-8885-075e9f0c1005 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: 3849d6f2-1dba-4e09-956d-54d873eea387] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:28.855688 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3906e169-3efc-4372-8885-075e9f0c1005 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:28.856937 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3906e169-3efc-4372-8885-075e9f0c1005 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:28.858551 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3906e169-3efc-4372-8885-075e9f0c1005 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:28.859165 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3906e169-3efc-4372-8885-075e9f0c1005 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:28.971495 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-3906e169-3efc-4372-8885-075e9f0c1005 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: 3849d6f2-1dba-4e09-956d-54d873eea387] Going to try to terminate instance {{(pid=97832) delete /opt/stack/nova/nova/compute/api.py:2559}} May 03 21:31:29.167977 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-ddd276d2-2ec8-43df-89ec-8f4d5365460a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:29.191880 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-ddd276d2-2ec8-43df-89ec-8f4d5365460a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:29.198678 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-ddd276d2-2ec8-43df-89ec-8f4d5365460a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:29.199752 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-ddd276d2-2ec8-43df-89ec-8f4d5365460a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1739 microversion: 2.20 time: 0.492289 May 03 21:31:29.200530 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 164/356] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:28 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1739 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:31:29.210680 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-583aa2e1-dc63-4a6d-bfda-22be6d706f07 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:29.211385 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-583aa2e1-dc63-4a6d-bfda-22be6d706f07 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:29.219056 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-583aa2e1-dc63-4a6d-bfda-22be6d706f07 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:29.219546 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-583aa2e1-dc63-4a6d-bfda-22be6d706f07 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:29.220565 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-583aa2e1-dc63-4a6d-bfda-22be6d706f07 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:29.220944 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-583aa2e1-dc63-4a6d-bfda-22be6d706f07 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:29.541583 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-583aa2e1-dc63-4a6d-bfda-22be6d706f07 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:29.551680 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-583aa2e1-dc63-4a6d-bfda-22be6d706f07 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f" status: 200 len: 1368 microversion: 2.1 time: 0.350275 May 03 21:31:29.562028 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 165/357] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:29 2022] GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f => generated 1368 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:29.564419 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-434daa7c-403f-454c-bfbf-ea9d4f70a161 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:29.565081 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-3906e169-3efc-4372-8885-075e9f0c1005 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387" status: 204 len: 0 microversion: 2.1 time: 0.734206 May 03 21:31:29.565202 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-434daa7c-403f-454c-bfbf-ea9d4f70a161 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:29.569060 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 193/358] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 3 21:31:28 2022] DELETE /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387 => generated 0 bytes in 736 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 03 21:31:29.576378 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-434daa7c-403f-454c-bfbf-ea9d4f70a161 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:29.576870 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-434daa7c-403f-454c-bfbf-ea9d4f70a161 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:29.577658 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-434daa7c-403f-454c-bfbf-ea9d4f70a161 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:29.578093 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-434daa7c-403f-454c-bfbf-ea9d4f70a161 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:29.579356 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-4fed9588-6c23-4d2b-b68b-ea51d743ed65 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:29.580417 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-4fed9588-6c23-4d2b-b68b-ea51d743ed65 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:29.588628 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4fed9588-6c23-4d2b-b68b-ea51d743ed65 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:29.589093 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4fed9588-6c23-4d2b-b68b-ea51d743ed65 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:29.594395 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4fed9588-6c23-4d2b-b68b-ea51d743ed65 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:29.594395 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4fed9588-6c23-4d2b-b68b-ea51d743ed65 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:29.904147 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-4fed9588-6c23-4d2b-b68b-ea51d743ed65 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:29.914924 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-4fed9588-6c23-4d2b-b68b-ea51d743ed65 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1722 microversion: 2.1 time: 0.347158 May 03 21:31:29.916072 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 194/359] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:29 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1722 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:29.947944 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-fe608c6b-4e63-4adb-be7e-e0afbab8bfbd tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:29.950100 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-fe608c6b-4e63-4adb-be7e-e0afbab8bfbd tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: 3849d6f2-1dba-4e09-956d-54d873eea387] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:29.991325 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fe608c6b-4e63-4adb-be7e-e0afbab8bfbd tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:29.991768 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fe608c6b-4e63-4adb-be7e-e0afbab8bfbd tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:29.993027 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fe608c6b-4e63-4adb-be7e-e0afbab8bfbd tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:29.996126 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fe608c6b-4e63-4adb-be7e-e0afbab8bfbd tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:30.043026 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-434daa7c-403f-454c-bfbf-ea9d4f70a161 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:30.057682 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-434daa7c-403f-454c-bfbf-ea9d4f70a161 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1370 microversion: 2.1 time: 0.502810 May 03 21:31:30.069296 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 166/360] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:29 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1370 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:30.263830 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-ba1a4d3e-6ae7-4ecf-9bb5-313e8d27b3e1 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:30.266997 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-ba1a4d3e-6ae7-4ecf-9bb5-313e8d27b3e1 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:30.284416 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ba1a4d3e-6ae7-4ecf-9bb5-313e8d27b3e1 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:30.285542 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ba1a4d3e-6ae7-4ecf-9bb5-313e8d27b3e1 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:30.287638 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ba1a4d3e-6ae7-4ecf-9bb5-313e8d27b3e1 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:30.288342 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ba1a4d3e-6ae7-4ecf-9bb5-313e8d27b3e1 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:30.467896 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-fe608c6b-4e63-4adb-be7e-e0afbab8bfbd tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:30.488189 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-fe608c6b-4e63-4adb-be7e-e0afbab8bfbd tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387" status: 200 len: 1503 microversion: 2.1 time: 0.570765 May 03 21:31:30.496616 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 195/361] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:29 2022] GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387 => generated 1503 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:30.588643 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-27a4a68f-a6f8-448f-b07b-0705c6e31d18 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:30.589258 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-27a4a68f-a6f8-448f-b07b-0705c6e31d18 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:30.600935 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-27a4a68f-a6f8-448f-b07b-0705c6e31d18 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:30.602591 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-27a4a68f-a6f8-448f-b07b-0705c6e31d18 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:30.603888 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-27a4a68f-a6f8-448f-b07b-0705c6e31d18 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:30.604529 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-27a4a68f-a6f8-448f-b07b-0705c6e31d18 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:30.701640 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-ba1a4d3e-6ae7-4ecf-9bb5-313e8d27b3e1 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:30.722930 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-ba1a4d3e-6ae7-4ecf-9bb5-313e8d27b3e1 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:30.731651 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-ba1a4d3e-6ae7-4ecf-9bb5-313e8d27b3e1 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:30.733097 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-ba1a4d3e-6ae7-4ecf-9bb5-313e8d27b3e1 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1739 microversion: 2.20 time: 0.509159 May 03 21:31:30.734438 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 167/362] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:30 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1739 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:31:30.749104 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-1cee7c6e-b106-4038-b1fc-d834d149fc35 req-3b2eb911-5364-40ce-80d9-3b03dc78d7bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b1e6cc5-801c-4aa5-92fa-1f490590cb9f", "name": "network-vif-plugged", "status": "completed", "tag": "da492c37-8214-4064-8e3b-45911d07e1d8"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:31:30.757337 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:31:30.757337 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:31:30.770687 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-1cee7c6e-b106-4038-b1fc-d834d149fc35 req-3b2eb911-5364-40ce-80d9-3b03dc78d7bf service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:30.771398 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-1cee7c6e-b106-4038-b1fc-d834d149fc35 req-3b2eb911-5364-40ce-80d9-3b03dc78d7bf service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:30.795761 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-1cee7c6e-b106-4038-b1fc-d834d149fc35 req-3b2eb911-5364-40ce-80d9-3b03dc78d7bf service nova] Creating event network-vif-plugged:da492c37-8214-4064-8e3b-45911d07e1d8 for instance 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f on hv-cinder-84037 May 03 21:31:30.801145 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-1cee7c6e-b106-4038-b1fc-d834d149fc35 req-3b2eb911-5364-40ce-80d9-3b03dc78d7bf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064985 May 03 21:31:30.802327 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 168/363] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:31:30.966594 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-e923dea7-e8d6-4d09-8e5d-74d3c1a3e48e tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:30.967298 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-e923dea7-e8d6-4d09-8e5d-74d3c1a3e48e tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:30.968977 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-27a4a68f-a6f8-448f-b07b-0705c6e31d18 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:30.982962 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e923dea7-e8d6-4d09-8e5d-74d3c1a3e48e tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:30.983411 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e923dea7-e8d6-4d09-8e5d-74d3c1a3e48e tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:30.984192 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e923dea7-e8d6-4d09-8e5d-74d3c1a3e48e tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:30.984710 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e923dea7-e8d6-4d09-8e5d-74d3c1a3e48e tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:30.987084 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-27a4a68f-a6f8-448f-b07b-0705c6e31d18 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f" status: 200 len: 1368 microversion: 2.1 time: 0.420655 May 03 21:31:30.987660 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 196/364] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:30 2022] GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f => generated 1368 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:31:31.083615 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-51fdf360-456b-4c68-a412-e69a4f850d04 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:31.085045 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-51fdf360-456b-4c68-a412-e69a4f850d04 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:31.102664 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-51fdf360-456b-4c68-a412-e69a4f850d04 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:31.103829 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-51fdf360-456b-4c68-a412-e69a4f850d04 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:31.105031 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-51fdf360-456b-4c68-a412-e69a4f850d04 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:31.105628 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-51fdf360-456b-4c68-a412-e69a4f850d04 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:31.416049 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-e923dea7-e8d6-4d09-8e5d-74d3c1a3e48e tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:31.426479 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-e923dea7-e8d6-4d09-8e5d-74d3c1a3e48e tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1722 microversion: 2.1 time: 0.494387 May 03 21:31:31.427046 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 169/365] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:30 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1722 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:31.528726 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-4120bd2e-1d4e-4aa0-9c2d-01af9b029e64 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:31.530899 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-4120bd2e-1d4e-4aa0-9c2d-01af9b029e64 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: 3849d6f2-1dba-4e09-956d-54d873eea387] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:31.537974 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-51fdf360-456b-4c68-a412-e69a4f850d04 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:31.541562 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4120bd2e-1d4e-4aa0-9c2d-01af9b029e64 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:31.542011 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4120bd2e-1d4e-4aa0-9c2d-01af9b029e64 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:31.543002 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4120bd2e-1d4e-4aa0-9c2d-01af9b029e64 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:31.543679 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4120bd2e-1d4e-4aa0-9c2d-01af9b029e64 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:31.548741 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-51fdf360-456b-4c68-a412-e69a4f850d04 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1370 microversion: 2.1 time: 0.476350 May 03 21:31:31.559114 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 197/366] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:31 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1370 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:31.764179 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-b475b55e-8205-4128-a721-fb8569de207c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:31.769410 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-b475b55e-8205-4128-a721-fb8569de207c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:31.784217 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b475b55e-8205-4128-a721-fb8569de207c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:31.784704 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b475b55e-8205-4128-a721-fb8569de207c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:31.785512 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b475b55e-8205-4128-a721-fb8569de207c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:31.785951 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b475b55e-8205-4128-a721-fb8569de207c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:31.871139 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-4120bd2e-1d4e-4aa0-9c2d-01af9b029e64 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:31.889892 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-4120bd2e-1d4e-4aa0-9c2d-01af9b029e64 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387" status: 200 len: 1503 microversion: 2.1 time: 0.381326 May 03 21:31:31.900657 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 170/367] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:31 2022] GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387 => generated 1503 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:31:32.018762 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-fd6356c8-3b26-4f1e-ab64-184fe848a825 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:32.019970 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-fd6356c8-3b26-4f1e-ab64-184fe848a825 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:32.034988 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fd6356c8-3b26-4f1e-ab64-184fe848a825 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:32.035591 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fd6356c8-3b26-4f1e-ab64-184fe848a825 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:32.036653 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fd6356c8-3b26-4f1e-ab64-184fe848a825 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:32.037411 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fd6356c8-3b26-4f1e-ab64-184fe848a825 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:32.076323 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-b475b55e-8205-4128-a721-fb8569de207c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:32.102636 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-b475b55e-8205-4128-a721-fb8569de207c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:32.120508 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-b475b55e-8205-4128-a721-fb8569de207c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:32.131263 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-b475b55e-8205-4128-a721-fb8569de207c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1739 microversion: 2.20 time: 0.379793 May 03 21:31:32.132447 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 198/368] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:31 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1739 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:31:32.340399 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-fd6356c8-3b26-4f1e-ab64-184fe848a825 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:32.358718 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-fd6356c8-3b26-4f1e-ab64-184fe848a825 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f" status: 200 len: 1368 microversion: 2.1 time: 0.354738 May 03 21:31:32.370075 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 171/369] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:32 2022] GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f => generated 1368 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:32.454665 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-e7d1b868-9218-4a0f-b062-68bdc76f47b0 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:32.455988 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-e7d1b868-9218-4a0f-b062-68bdc76f47b0 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:32.465945 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e7d1b868-9218-4a0f-b062-68bdc76f47b0 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:32.466784 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e7d1b868-9218-4a0f-b062-68bdc76f47b0 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:32.467908 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e7d1b868-9218-4a0f-b062-68bdc76f47b0 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:32.468615 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e7d1b868-9218-4a0f-b062-68bdc76f47b0 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:32.580970 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-516a08d6-157d-4a58-adc9-84763071a093 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:32.609726 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-516a08d6-157d-4a58-adc9-84763071a093 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:32.612031 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-516a08d6-157d-4a58-adc9-84763071a093 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:32.620231 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-516a08d6-157d-4a58-adc9-84763071a093 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:32.621167 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-516a08d6-157d-4a58-adc9-84763071a093 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:32.621621 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-516a08d6-157d-4a58-adc9-84763071a093 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:32.821764 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-e7d1b868-9218-4a0f-b062-68bdc76f47b0 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:32.838538 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-e7d1b868-9218-4a0f-b062-68bdc76f47b0 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1722 microversion: 2.1 time: 0.396572 May 03 21:31:32.848709 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 199/370] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:32 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1722 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:31:32.860464 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-e5718597-aa02-4bae-a41a-83d5def86fe9 req-db269793-323f-479e-b2ea-5f055d88a521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f6a8a2-4366-486d-a002-05587e0f46b5", "name": "network-vif-plugged", "status": "completed", "tag": "be428a12-3d87-4da1-a665-e7b79df6af66"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:31:32.867227 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:31:32.867227 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:31:32.877873 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-e5718597-aa02-4bae-a41a-83d5def86fe9 req-db269793-323f-479e-b2ea-5f055d88a521 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:32.878433 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-e5718597-aa02-4bae-a41a-83d5def86fe9 req-db269793-323f-479e-b2ea-5f055d88a521 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:32.897745 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-e5718597-aa02-4bae-a41a-83d5def86fe9 req-db269793-323f-479e-b2ea-5f055d88a521 service nova] Creating event network-vif-plugged:be428a12-3d87-4da1-a665-e7b79df6af66 for instance 77f6a8a2-4366-486d-a002-05587e0f46b5 on hv-cinder-84037 May 03 21:31:32.904076 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-e5718597-aa02-4bae-a41a-83d5def86fe9 req-db269793-323f-479e-b2ea-5f055d88a521 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053857 May 03 21:31:32.905104 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 200/371] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:31:32.916904 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-2e96cece-7bd9-4164-b876-3f298780e353 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:32.918817 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-516a08d6-157d-4a58-adc9-84763071a093 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:32.921004 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-2e96cece-7bd9-4164-b876-3f298780e353 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: 3849d6f2-1dba-4e09-956d-54d873eea387] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:32.932801 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-516a08d6-157d-4a58-adc9-84763071a093 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1370 microversion: 2.1 time: 0.369080 May 03 21:31:32.943828 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 172/372] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:32 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1370 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:32.944889 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2e96cece-7bd9-4164-b876-3f298780e353 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:32.945380 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2e96cece-7bd9-4164-b876-3f298780e353 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:32.946970 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2e96cece-7bd9-4164-b876-3f298780e353 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:32.947559 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2e96cece-7bd9-4164-b876-3f298780e353 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:33.158729 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-08bc8432-5954-455e-9e58-d684af9b93aa tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:33.163515 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-08bc8432-5954-455e-9e58-d684af9b93aa tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:33.182640 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-08bc8432-5954-455e-9e58-d684af9b93aa tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:33.184239 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-08bc8432-5954-455e-9e58-d684af9b93aa tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:33.185199 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-08bc8432-5954-455e-9e58-d684af9b93aa tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:33.185749 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-08bc8432-5954-455e-9e58-d684af9b93aa tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:33.220717 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-2e96cece-7bd9-4164-b876-3f298780e353 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:33.233879 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-2e96cece-7bd9-4164-b876-3f298780e353 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387" status: 200 len: 1503 microversion: 2.1 time: 0.327460 May 03 21:31:33.234917 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 201/373] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:32 2022] GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387 => generated 1503 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:33.382910 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-a6abbd6d-c787-4289-b663-e8831c475583 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:33.384246 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-a6abbd6d-c787-4289-b663-e8831c475583 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:33.392167 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a6abbd6d-c787-4289-b663-e8831c475583 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:33.392866 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a6abbd6d-c787-4289-b663-e8831c475583 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:33.393796 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a6abbd6d-c787-4289-b663-e8831c475583 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:33.394378 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a6abbd6d-c787-4289-b663-e8831c475583 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:33.470556 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-08bc8432-5954-455e-9e58-d684af9b93aa tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:33.541949 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-08bc8432-5954-455e-9e58-d684af9b93aa tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:33.575328 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-08bc8432-5954-455e-9e58-d684af9b93aa tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:33.577281 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-08bc8432-5954-455e-9e58-d684af9b93aa tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1739 microversion: 2.20 time: 0.429655 May 03 21:31:33.578327 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 173/374] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:33 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1739 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 21:31:33.713726 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-a6abbd6d-c787-4289-b663-e8831c475583 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:33.722650 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-a6abbd6d-c787-4289-b663-e8831c475583 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f" status: 200 len: 1368 microversion: 2.1 time: 0.349662 May 03 21:31:33.723532 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 202/375] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:33 2022] GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f => generated 1368 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:31:33.884569 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-b23d81df-b667-45bf-98c0-3dcaea681d16 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:33.886524 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-b23d81df-b667-45bf-98c0-3dcaea681d16 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:33.919000 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b23d81df-b667-45bf-98c0-3dcaea681d16 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:33.919000 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b23d81df-b667-45bf-98c0-3dcaea681d16 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:33.919000 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b23d81df-b667-45bf-98c0-3dcaea681d16 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:33.919000 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b23d81df-b667-45bf-98c0-3dcaea681d16 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:33.967053 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-f39f42cc-2c4e-48fd-b0bb-3fbe701cc826 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:33.967685 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-f39f42cc-2c4e-48fd-b0bb-3fbe701cc826 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:33.982744 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f39f42cc-2c4e-48fd-b0bb-3fbe701cc826 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:33.983415 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f39f42cc-2c4e-48fd-b0bb-3fbe701cc826 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:33.984232 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f39f42cc-2c4e-48fd-b0bb-3fbe701cc826 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:33.985731 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f39f42cc-2c4e-48fd-b0bb-3fbe701cc826 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:34.289099 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-b23d81df-b667-45bf-98c0-3dcaea681d16 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:34.289099 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-b23d81df-b667-45bf-98c0-3dcaea681d16 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1722 microversion: 2.1 time: 0.398475 May 03 21:31:34.289099 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 174/376] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:33 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1722 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:34.289099 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-5c6f08d0-3910-4e90-bb44-5be43ef53a97 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:34.291371 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-5c6f08d0-3910-4e90-bb44-5be43ef53a97 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: 3849d6f2-1dba-4e09-956d-54d873eea387] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:34.293581 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5c6f08d0-3910-4e90-bb44-5be43ef53a97 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:34.294031 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5c6f08d0-3910-4e90-bb44-5be43ef53a97 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:34.294813 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5c6f08d0-3910-4e90-bb44-5be43ef53a97 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:34.295249 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5c6f08d0-3910-4e90-bb44-5be43ef53a97 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:34.314478 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-f39f42cc-2c4e-48fd-b0bb-3fbe701cc826 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:34.330500 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-f39f42cc-2c4e-48fd-b0bb-3fbe701cc826 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1370 microversion: 2.1 time: 0.382303 May 03 21:31:34.332623 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 203/377] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:33 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1370 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:34.613475 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-4e1a085b-5e71-4f32-8d80-1bd152a4f84a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:34.616496 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-4e1a085b-5e71-4f32-8d80-1bd152a4f84a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:34.632634 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4e1a085b-5e71-4f32-8d80-1bd152a4f84a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:34.634029 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4e1a085b-5e71-4f32-8d80-1bd152a4f84a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:34.635736 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4e1a085b-5e71-4f32-8d80-1bd152a4f84a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:34.641343 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4e1a085b-5e71-4f32-8d80-1bd152a4f84a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:35.037325 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-5c6f08d0-3910-4e90-bb44-5be43ef53a97 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:35.059716 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-5c6f08d0-3910-4e90-bb44-5be43ef53a97 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387" status: 200 len: 1503 microversion: 2.1 time: 0.786459 May 03 21:31:35.068976 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 175/378] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:34 2022] GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387 => generated 1503 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:35.085302 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-20b2cc71-1707-4b41-b6ce-10b1a1c8dc51 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:35.087349 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-20b2cc71-1707-4b41-b6ce-10b1a1c8dc51 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:35.111722 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-20b2cc71-1707-4b41-b6ce-10b1a1c8dc51 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:35.112918 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-20b2cc71-1707-4b41-b6ce-10b1a1c8dc51 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:35.115855 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-20b2cc71-1707-4b41-b6ce-10b1a1c8dc51 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:35.117292 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-20b2cc71-1707-4b41-b6ce-10b1a1c8dc51 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:35.196462 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-4e1a085b-5e71-4f32-8d80-1bd152a4f84a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:35.219495 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-4e1a085b-5e71-4f32-8d80-1bd152a4f84a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:35.227132 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-4e1a085b-5e71-4f32-8d80-1bd152a4f84a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:35.228777 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-4e1a085b-5e71-4f32-8d80-1bd152a4f84a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1739 microversion: 2.20 time: 0.632411 May 03 21:31:35.229877 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 204/379] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:34 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1739 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:31:35.248650 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-ed31ffbd-739d-44eb-9b81-40954ed9f002 req-0c5b13a6-4ea8-4485-a495-0f003cb9d61a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb2b9b5d-640a-401a-ac60-566b6d8dbc52", "name": "network-vif-plugged", "status": "completed", "tag": "a2903b13-fffc-4e5f-9a12-4bcb585327dd"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:31:35.255412 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:31:35.255412 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:31:35.265388 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-ed31ffbd-739d-44eb-9b81-40954ed9f002 req-0c5b13a6-4ea8-4485-a495-0f003cb9d61a service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:35.265848 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-ed31ffbd-739d-44eb-9b81-40954ed9f002 req-0c5b13a6-4ea8-4485-a495-0f003cb9d61a service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:35.285179 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-ed31ffbd-739d-44eb-9b81-40954ed9f002 req-0c5b13a6-4ea8-4485-a495-0f003cb9d61a service nova] Creating event network-vif-plugged:a2903b13-fffc-4e5f-9a12-4bcb585327dd for instance cb2b9b5d-640a-401a-ac60-566b6d8dbc52 on hv-cinder-84037 May 03 21:31:35.290645 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-ed31ffbd-739d-44eb-9b81-40954ed9f002 req-0c5b13a6-4ea8-4485-a495-0f003cb9d61a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059077 May 03 21:31:35.291396 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 205/380] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:31:35.310755 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-bcec2f4d-b090-486f-bbf7-1e68e6293da6 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:35.311506 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-bcec2f4d-b090-486f-bbf7-1e68e6293da6 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:35.320238 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-bcec2f4d-b090-486f-bbf7-1e68e6293da6 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:35.321006 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-bcec2f4d-b090-486f-bbf7-1e68e6293da6 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:35.321547 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-bcec2f4d-b090-486f-bbf7-1e68e6293da6 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:35.322081 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-bcec2f4d-b090-486f-bbf7-1e68e6293da6 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:35.682626 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-bcec2f4d-b090-486f-bbf7-1e68e6293da6 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:35.706832 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-bcec2f4d-b090-486f-bbf7-1e68e6293da6 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1722 microversion: 2.1 time: 0.413748 May 03 21:31:35.707807 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 206/381] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:35 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1722 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:35.752734 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-10f5d78c-1386-4705-80da-c51aaaff50c7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:35.754216 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-10f5d78c-1386-4705-80da-c51aaaff50c7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:35.768642 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-10f5d78c-1386-4705-80da-c51aaaff50c7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:35.769656 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-10f5d78c-1386-4705-80da-c51aaaff50c7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:35.771303 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-10f5d78c-1386-4705-80da-c51aaaff50c7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:35.772239 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-10f5d78c-1386-4705-80da-c51aaaff50c7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:36.239594 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-20b2cc71-1707-4b41-b6ce-10b1a1c8dc51 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:36.265376 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-20b2cc71-1707-4b41-b6ce-10b1a1c8dc51 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f" status: 200 len: 1368 microversion: 2.1 time: 1.202820 May 03 21:31:36.271385 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 176/382] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:35 2022] GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f => generated 1368 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:36.284963 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-10f5d78c-1386-4705-80da-c51aaaff50c7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:36.289071 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-d8fc87a1-cb1a-43f5-8b9c-9fff9b724d24 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:36.291021 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-d8fc87a1-cb1a-43f5-8b9c-9fff9b724d24 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: 3849d6f2-1dba-4e09-956d-54d873eea387] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:36.294963 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-10f5d78c-1386-4705-80da-c51aaaff50c7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1370 microversion: 2.1 time: 0.570620 May 03 21:31:36.295716 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 207/383] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:35 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1370 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:36.310938 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d8fc87a1-cb1a-43f5-8b9c-9fff9b724d24 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:36.311470 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d8fc87a1-cb1a-43f5-8b9c-9fff9b724d24 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:36.312327 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d8fc87a1-cb1a-43f5-8b9c-9fff9b724d24 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:36.312996 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d8fc87a1-cb1a-43f5-8b9c-9fff9b724d24 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:36.320233 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-a21f97e4-4f43-4a03-9b67-6568383dd831 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:36.326866 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-a21f97e4-4f43-4a03-9b67-6568383dd831 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:36.336351 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a21f97e4-4f43-4a03-9b67-6568383dd831 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:36.337134 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a21f97e4-4f43-4a03-9b67-6568383dd831 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:36.338165 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a21f97e4-4f43-4a03-9b67-6568383dd831 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:36.338744 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a21f97e4-4f43-4a03-9b67-6568383dd831 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:36.606394 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-d8fc87a1-cb1a-43f5-8b9c-9fff9b724d24 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:36.631281 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-d8fc87a1-cb1a-43f5-8b9c-9fff9b724d24 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387" status: 200 len: 1461 microversion: 2.1 time: 0.361536 May 03 21:31:36.635318 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 177/384] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:36 2022] GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387 => generated 1461 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:36.658752 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-7ec9eeeb-6ed7-4696-8ab0-86c41d16e4f6 req-2f601109-2af9-4992-a13d-2fd436b42439 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3849d6f2-1dba-4e09-956d-54d873eea387", "name": "network-vif-deleted", "tag": "ee0150a2-32c4-464b-8988-0efae2a38c5c"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:31:36.668478 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:31:36.668478 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:31:36.678618 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-7ec9eeeb-6ed7-4696-8ab0-86c41d16e4f6 req-2f601109-2af9-4992-a13d-2fd436b42439 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:36.679359 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-7ec9eeeb-6ed7-4696-8ab0-86c41d16e4f6 req-2f601109-2af9-4992-a13d-2fd436b42439 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:36.703787 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-7ec9eeeb-6ed7-4696-8ab0-86c41d16e4f6 req-2f601109-2af9-4992-a13d-2fd436b42439 service nova] Creating event network-vif-deleted:ee0150a2-32c4-464b-8988-0efae2a38c5c for instance 3849d6f2-1dba-4e09-956d-54d873eea387 on hv-cinder-84037 May 03 21:31:36.712602 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-a21f97e4-4f43-4a03-9b67-6568383dd831 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:36.725264 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-7ec9eeeb-6ed7-4696-8ab0-86c41d16e4f6 req-2f601109-2af9-4992-a13d-2fd436b42439 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087810 May 03 21:31:36.726320 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 178/385] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:31:36.731555 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-a21f97e4-4f43-4a03-9b67-6568383dd831 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:36.741045 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-a21f97e4-4f43-4a03-9b67-6568383dd831 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:36.743506 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-a21f97e4-4f43-4a03-9b67-6568383dd831 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1739 microversion: 2.20 time: 0.446649 May 03 21:31:36.755638 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 208/386] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:36 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1739 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:31:36.764765 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-c095e434-70c2-44b3-98bf-235304df4915 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:36.765724 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-c095e434-70c2-44b3-98bf-235304df4915 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:36.776339 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c095e434-70c2-44b3-98bf-235304df4915 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:36.779898 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c095e434-70c2-44b3-98bf-235304df4915 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:36.779898 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c095e434-70c2-44b3-98bf-235304df4915 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:36.779898 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c095e434-70c2-44b3-98bf-235304df4915 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:37.183300 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-c095e434-70c2-44b3-98bf-235304df4915 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:37.207473 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-c095e434-70c2-44b3-98bf-235304df4915 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1722 microversion: 2.1 time: 0.463564 May 03 21:31:37.208299 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 179/387] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:36 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1722 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:37.336021 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-9c39c13f-1d2b-4e9a-b435-6fa76b1e3572 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:37.338488 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-9c39c13f-1d2b-4e9a-b435-6fa76b1e3572 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:37.344233 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-0d4399c4-282e-459d-a616-c2731963d978 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:37.351258 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-0d4399c4-282e-459d-a616-c2731963d978 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:37.366006 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9c39c13f-1d2b-4e9a-b435-6fa76b1e3572 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:37.371458 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9c39c13f-1d2b-4e9a-b435-6fa76b1e3572 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:37.373383 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9c39c13f-1d2b-4e9a-b435-6fa76b1e3572 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:37.374469 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9c39c13f-1d2b-4e9a-b435-6fa76b1e3572 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:37.376698 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0d4399c4-282e-459d-a616-c2731963d978 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:37.376945 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0d4399c4-282e-459d-a616-c2731963d978 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:37.377993 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0d4399c4-282e-459d-a616-c2731963d978 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:37.378451 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0d4399c4-282e-459d-a616-c2731963d978 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:37.871711 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-9c39c13f-1d2b-4e9a-b435-6fa76b1e3572 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:37.881263 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-0d4399c4-282e-459d-a616-c2731963d978 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:37.884968 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-9c39c13f-1d2b-4e9a-b435-6fa76b1e3572 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f" status: 200 len: 1557 microversion: 2.1 time: 0.601377 May 03 21:31:37.886660 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 209/388] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:37 2022] GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f => generated 1557 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:37.902576 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-0d4399c4-282e-459d-a616-c2731963d978 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1370 microversion: 2.1 time: 0.594116 May 03 21:31:37.903441 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 180/389] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:37 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1370 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:31:37.914173 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-146a4750-b746-4813-b829-ee9b2878e283 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:37.914424 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-cd70c264-d33e-46fc-866e-544c813e0172 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:37.914536 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-146a4750-b746-4813-b829-ee9b2878e283 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: 3849d6f2-1dba-4e09-956d-54d873eea387] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:37.914782 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-cd70c264-d33e-46fc-866e-544c813e0172 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:37.924007 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-cd70c264-d33e-46fc-866e-544c813e0172 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:37.924007 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-cd70c264-d33e-46fc-866e-544c813e0172 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:37.924307 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-146a4750-b746-4813-b829-ee9b2878e283 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:37.924751 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-146a4750-b746-4813-b829-ee9b2878e283 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:37.924932 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-cd70c264-d33e-46fc-866e-544c813e0172 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:37.925381 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-cd70c264-d33e-46fc-866e-544c813e0172 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:37.925801 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-146a4750-b746-4813-b829-ee9b2878e283 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:37.926328 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-146a4750-b746-4813-b829-ee9b2878e283 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:38.066298 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-146a4750-b746-4813-b829-ee9b2878e283 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:38.068611 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-146a4750-b746-4813-b829-ee9b2878e283 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:38.069936 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.objects.instance [None req-146a4750-b746-4813-b829-ee9b2878e283 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lazy-loading 'fault' on Instance uuid 3849d6f2-1dba-4e09-956d-54d873eea387 {{(pid=97832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 03 21:31:38.212807 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-146a4750-b746-4813-b829-ee9b2878e283 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:38.230771 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-146a4750-b746-4813-b829-ee9b2878e283 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387" status: 200 len: 1304 microversion: 2.1 time: 0.341184 May 03 21:31:38.233612 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 210/390] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:37 2022] GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387 => generated 1304 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:38.246468 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-ab873e7a-e9b0-4495-bd8a-fe2cd3a96334 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:38.247115 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-ab873e7a-e9b0-4495-bd8a-fe2cd3a96334 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:38.262233 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ab873e7a-e9b0-4495-bd8a-fe2cd3a96334 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:38.263096 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ab873e7a-e9b0-4495-bd8a-fe2cd3a96334 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:38.264594 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ab873e7a-e9b0-4495-bd8a-fe2cd3a96334 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:38.265174 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ab873e7a-e9b0-4495-bd8a-fe2cd3a96334 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:38.266822 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-cd70c264-d33e-46fc-866e-544c813e0172 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:38.292918 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-cd70c264-d33e-46fc-866e-544c813e0172 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:38.304556 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-cd70c264-d33e-46fc-866e-544c813e0172 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:38.307799 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-cd70c264-d33e-46fc-866e-544c813e0172 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1739 microversion: 2.20 time: 0.402432 May 03 21:31:38.310251 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 181/391] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:37 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1739 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:31:38.327176 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-f0f774ca-000f-4882-b6a6-d1d3115497e0 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:38.327806 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-f0f774ca-000f-4882-b6a6-d1d3115497e0 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:38.336218 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f0f774ca-000f-4882-b6a6-d1d3115497e0 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:38.336860 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f0f774ca-000f-4882-b6a6-d1d3115497e0 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:38.337792 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f0f774ca-000f-4882-b6a6-d1d3115497e0 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:38.338506 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f0f774ca-000f-4882-b6a6-d1d3115497e0 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:38.645228 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-ab873e7a-e9b0-4495-bd8a-fe2cd3a96334 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.410352 May 03 21:31:38.646160 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 211/392] 10.222.0.48 () {58 vars in 1274 bytes} [Tue May 3 21:31:38 2022] GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f/os-interface => generated 284 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:31:38.733088 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-f0f774ca-000f-4882-b6a6-d1d3115497e0 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:38.754534 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-f0f774ca-000f-4882-b6a6-d1d3115497e0 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1722 microversion: 2.1 time: 0.442915 May 03 21:31:38.758976 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 182/393] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:38 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1722 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:38.927597 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-23f481a3-1e8f-40a6-a095-7d3786aa4b55 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:38.928229 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-23f481a3-1e8f-40a6-a095-7d3786aa4b55 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:38.936697 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-23f481a3-1e8f-40a6-a095-7d3786aa4b55 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:38.937008 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-23f481a3-1e8f-40a6-a095-7d3786aa4b55 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:38.937901 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-23f481a3-1e8f-40a6-a095-7d3786aa4b55 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:38.938426 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-23f481a3-1e8f-40a6-a095-7d3786aa4b55 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:39.277618 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-cf880516-4001-4de3-bf58-8a9471bd8917 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:39.280012 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-cf880516-4001-4de3-bf58-8a9471bd8917 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: 3849d6f2-1dba-4e09-956d-54d873eea387] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:39.289473 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-cf880516-4001-4de3-bf58-8a9471bd8917 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:39.289473 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-cf880516-4001-4de3-bf58-8a9471bd8917 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:39.289473 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-cf880516-4001-4de3-bf58-8a9471bd8917 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:39.289717 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-cf880516-4001-4de3-bf58-8a9471bd8917 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:39.413692 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-cf880516-4001-4de3-bf58-8a9471bd8917 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:39.414165 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-cf880516-4001-4de3-bf58-8a9471bd8917 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:39.414625 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.objects.instance [None req-cf880516-4001-4de3-bf58-8a9471bd8917 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lazy-loading 'fault' on Instance uuid 3849d6f2-1dba-4e09-956d-54d873eea387 {{(pid=97831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 03 21:31:39.654367 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-cf880516-4001-4de3-bf58-8a9471bd8917 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:39.662769 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-cf880516-4001-4de3-bf58-8a9471bd8917 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387" status: 200 len: 1304 microversion: 2.1 time: 0.410584 May 03 21:31:39.666052 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 183/394] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:39 2022] GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387 => generated 1304 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:39.675660 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-354632bc-661e-4cda-b13a-9b15a4bb3880 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:39.676383 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-354632bc-661e-4cda-b13a-9b15a4bb3880 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:39.685744 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-354632bc-661e-4cda-b13a-9b15a4bb3880 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:39.686308 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-354632bc-661e-4cda-b13a-9b15a4bb3880 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:39.687203 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-354632bc-661e-4cda-b13a-9b15a4bb3880 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:39.687713 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-354632bc-661e-4cda-b13a-9b15a4bb3880 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:39.987004 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-354632bc-661e-4cda-b13a-9b15a4bb3880 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:40.017545 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-23f481a3-1e8f-40a6-a095-7d3786aa4b55 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:40.030916 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-23f481a3-1e8f-40a6-a095-7d3786aa4b55 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1565 microversion: 2.1 time: 1.114718 May 03 21:31:40.045206 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 212/395] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:38 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1565 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:40.057776 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-200f1ff0-0256-4c78-9d47-29c582815344 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:40.058349 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-354632bc-661e-4cda-b13a-9b15a4bb3880 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:40.058516 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-200f1ff0-0256-4c78-9d47-29c582815344 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:40.066674 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-200f1ff0-0256-4c78-9d47-29c582815344 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:40.067131 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-200f1ff0-0256-4c78-9d47-29c582815344 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:40.067923 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-200f1ff0-0256-4c78-9d47-29c582815344 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:40.068358 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-200f1ff0-0256-4c78-9d47-29c582815344 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:40.074188 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-354632bc-661e-4cda-b13a-9b15a4bb3880 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:40.075514 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-354632bc-661e-4cda-b13a-9b15a4bb3880 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1739 microversion: 2.20 time: 0.409761 May 03 21:31:40.081926 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 184/396] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:39 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1739 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:31:40.102166 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-83b77170-e334-4a79-915a-3c8908faf8e4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:40.108217 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-83b77170-e334-4a79-915a-3c8908faf8e4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:40.126230 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-83b77170-e334-4a79-915a-3c8908faf8e4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:40.126836 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-83b77170-e334-4a79-915a-3c8908faf8e4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:40.128896 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-83b77170-e334-4a79-915a-3c8908faf8e4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:40.129452 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-83b77170-e334-4a79-915a-3c8908faf8e4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:40.358344 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-83b77170-e334-4a79-915a-3c8908faf8e4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.275187 May 03 21:31:40.365293 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 185/397] 10.222.0.48 () {58 vars in 1274 bytes} [Tue May 3 21:31:40 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52/os-interface => generated 285 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:31:40.381268 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-8cb05d99-4bf9-4d50-9f08-356572f5f7e7 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:40.382238 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-8cb05d99-4bf9-4d50-9f08-356572f5f7e7 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 71fcec7c-c868-4296-b92d-704179c12e86] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:40.400260 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8cb05d99-4bf9-4d50-9f08-356572f5f7e7 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:40.402684 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8cb05d99-4bf9-4d50-9f08-356572f5f7e7 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:40.403672 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8cb05d99-4bf9-4d50-9f08-356572f5f7e7 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:40.404214 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8cb05d99-4bf9-4d50-9f08-356572f5f7e7 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:40.644830 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-200f1ff0-0256-4c78-9d47-29c582815344 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:40.669711 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-200f1ff0-0256-4c78-9d47-29c582815344 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1722 microversion: 2.1 time: 0.622574 May 03 21:31:40.683975 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 213/398] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:40 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1722 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:40.702340 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-3bb447fc-d8d1-4acd-ba39-a314e99885bd tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:40.703001 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-3bb447fc-d8d1-4acd-ba39-a314e99885bd tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: 3849d6f2-1dba-4e09-956d-54d873eea387] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:40.731315 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3bb447fc-d8d1-4acd-ba39-a314e99885bd tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:40.732862 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3bb447fc-d8d1-4acd-ba39-a314e99885bd tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:40.735208 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3bb447fc-d8d1-4acd-ba39-a314e99885bd tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:40.735666 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3bb447fc-d8d1-4acd-ba39-a314e99885bd tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:40.889077 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.wsgi [None req-3bb447fc-d8d1-4acd-ba39-a314e99885bd tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] HTTP exception thrown: Instance 3849d6f2-1dba-4e09-956d-54d873eea387 could not be found. May 03 21:31:40.892770 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-3bb447fc-d8d1-4acd-ba39-a314e99885bd tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Returning 404 to user: Instance 3849d6f2-1dba-4e09-956d-54d873eea387 could not be found. {{(pid=97832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:31:40.895277 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-3bb447fc-d8d1-4acd-ba39-a314e99885bd tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387" status: 404 len: 111 microversion: 2.1 time: 0.208356 May 03 21:31:40.902252 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 214/399] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:40 2022] GET /compute/v2.1/servers/3849d6f2-1dba-4e09-956d-54d873eea387 => generated 111 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 03 21:31:41.124682 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-6ca1cef0-8049-4d58-84e2-19c3b5dd14bc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:41.135114 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-6ca1cef0-8049-4d58-84e2-19c3b5dd14bc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:41.161585 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6ca1cef0-8049-4d58-84e2-19c3b5dd14bc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:41.162164 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6ca1cef0-8049-4d58-84e2-19c3b5dd14bc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:41.163033 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6ca1cef0-8049-4d58-84e2-19c3b5dd14bc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:41.163971 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6ca1cef0-8049-4d58-84e2-19c3b5dd14bc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:41.306696 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-8cb05d99-4bf9-4d50-9f08-356572f5f7e7 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "DELETE /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86/os-volume_attachments/7a4c6d09-f23b-4ed9-bd6f-8c30fb7bf856" status: 202 len: 0 microversion: 2.1 time: 0.946183 May 03 21:31:41.307751 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 186/400] 10.222.0.48 () {58 vars in 1415 bytes} [Tue May 3 21:31:40 2022] DELETE /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86/os-volume_attachments/7a4c6d09-f23b-4ed9-bd6f-8c30fb7bf856 => generated 0 bytes in 948 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 21:31:41.327288 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-488d34c2-2d7d-4699-af9c-80ca8a2ba941 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1674043611", "imageRef": "f5214328-64f1-4aa6-aa05-61f0189e0e1e", "flavorRef": "452", "networks": [{"uuid": "8728a8ce-db6a-4720-bb6e-c96e6c9ab260"}]}} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:31:41.491192 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.network.neutron [None req-488d34c2-2d7d-4699-af9c-80ca8a2ba941 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] validate_networks() for [('8728a8ce-db6a-4720-bb6e-c96e6c9ab260', None, None, None)] {{(pid=97831) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} May 03 21:31:41.790149 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-6ca1cef0-8049-4d58-84e2-19c3b5dd14bc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:41.810509 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-6ca1cef0-8049-4d58-84e2-19c3b5dd14bc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:41.819024 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-6ca1cef0-8049-4d58-84e2-19c3b5dd14bc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:41.820842 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-6ca1cef0-8049-4d58-84e2-19c3b5dd14bc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1739 microversion: 2.20 time: 0.719477 May 03 21:31:41.831945 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 215/401] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:41 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1739 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 21:31:41.859864 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-2cd4ea63-1b9e-43c1-96c3-36be1a15bc40 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:41.864012 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-2cd4ea63-1b9e-43c1-96c3-36be1a15bc40 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:41.886430 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2cd4ea63-1b9e-43c1-96c3-36be1a15bc40 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:41.886890 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2cd4ea63-1b9e-43c1-96c3-36be1a15bc40 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:41.887687 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2cd4ea63-1b9e-43c1-96c3-36be1a15bc40 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:41.888124 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2cd4ea63-1b9e-43c1-96c3-36be1a15bc40 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:42.371978 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-2cd4ea63-1b9e-43c1-96c3-36be1a15bc40 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:42.390027 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-2cd4ea63-1b9e-43c1-96c3-36be1a15bc40 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1699 microversion: 2.1 time: 0.556466 May 03 21:31:42.390659 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 216/402] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:41 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1699 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:42.441094 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-b5802ce2-4fc5-4e7a-82bb-d60a240bc471 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:31:42.451522 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b5802ce2-4fc5-4e7a-82bb-d60a240bc471 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:42.451976 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b5802ce2-4fc5-4e7a-82bb-d60a240bc471 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:42.649729 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-b5802ce2-4fc5-4e7a-82bb-d60a240bc471 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Going to try to start instance {{(pid=97832) start /opt/stack/nova/nova/compute/api.py:2622}} May 03 21:31:42.735973 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-488d34c2-2d7d-4699-af9c-80ca8a2ba941 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Flavor limits 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} May 03 21:31:42.736569 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-488d34c2-2d7d-4699-af9c-80ca8a2ba941 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Image limits 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} May 03 21:31:42.737694 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-488d34c2-2d7d-4699-af9c-80ca8a2ba941 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Flavor pref 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} May 03 21:31:42.738183 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-488d34c2-2d7d-4699-af9c-80ca8a2ba941 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Image pref 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} May 03 21:31:42.738872 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-488d34c2-2d7d-4699-af9c-80ca8a2ba941 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} May 03 21:31:42.751092 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-488d34c2-2d7d-4699-af9c-80ca8a2ba941 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:42.752013 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-488d34c2-2d7d-4699-af9c-80ca8a2ba941 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:42.752958 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-488d34c2-2d7d-4699-af9c-80ca8a2ba941 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:42.753775 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-488d34c2-2d7d-4699-af9c-80ca8a2ba941 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:42.779480 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-488d34c2-2d7d-4699-af9c-80ca8a2ba941 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Getting quotas for project ed2eb47de9ab494c8061632f766f1050. Resources: {'instances', 'ram', 'cores'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:31:42.826192 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-488d34c2-2d7d-4699-af9c-80ca8a2ba941 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Getting quotas for user ce53c9c393cd431aa932c98352644d89 and project ed2eb47de9ab494c8061632f766f1050. Resources: {'instances', 'ram', 'cores'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:31:42.826192 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-488d34c2-2d7d-4699-af9c-80ca8a2ba941 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Going to run 1 instances... {{(pid=97831) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} May 03 21:31:42.826192 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-488d34c2-2d7d-4699-af9c-80ca8a2ba941 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: b5b63d26-d36d-440d-9107-9d20ffc97ecf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5214328-64f1-4aa6-aa05-61f0189e0e1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=97831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} May 03 21:31:44.000662 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-488d34c2-2d7d-4699-af9c-80ca8a2ba941 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.691011 May 03 21:31:44.009002 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 187/403] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 3 21:31:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 03 21:31:44.017646 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-b5802ce2-4fc5-4e7a-82bb-d60a240bc471 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "POST /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a/action" status: 202 len: 0 microversion: 2.1 time: 1.586186 May 03 21:31:44.018862 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 217/404] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 3 21:31:42 2022] POST /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a/action => generated 0 bytes in 1589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 21:31:44.039328 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-e7334d34-18e2-431b-8996-b8863f2a6d1a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:44.042184 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-e7334d34-18e2-431b-8996-b8863f2a6d1a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:44.085768 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-f6d3142a-fb86-4d5f-8286-afcd0e6714ff req-941b77c2-d008-4b1e-a645-1740ff4984f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b1e6cc5-801c-4aa5-92fa-1f490590cb9f", "tag": "da492c37-8214-4064-8e3b-45911d07e1d8"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:31:44.089298 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e7334d34-18e2-431b-8996-b8863f2a6d1a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:44.096367 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e7334d34-18e2-431b-8996-b8863f2a6d1a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:44.103792 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e7334d34-18e2-431b-8996-b8863f2a6d1a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:44.103792 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e7334d34-18e2-431b-8996-b8863f2a6d1a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:44.132248 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:31:44.132248 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:31:44.220672 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-f6d3142a-fb86-4d5f-8286-afcd0e6714ff req-941b77c2-d008-4b1e-a645-1740ff4984f1 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:44.222386 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-f6d3142a-fb86-4d5f-8286-afcd0e6714ff req-941b77c2-d008-4b1e-a645-1740ff4984f1 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:44.378437 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-f6d3142a-fb86-4d5f-8286-afcd0e6714ff req-941b77c2-d008-4b1e-a645-1740ff4984f1 service nova] Creating event network-changed:da492c37-8214-4064-8e3b-45911d07e1d8 for instance 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f on hv-cinder-84037 May 03 21:31:44.434263 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-f6d3142a-fb86-4d5f-8286-afcd0e6714ff req-941b77c2-d008-4b1e-a645-1740ff4984f1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.417045 May 03 21:31:44.437029 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 188/405] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:31:44.608307 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-928325c8-a226-40f0-9b98-07ea9740bfe5 req-b51b645e-f8ea-4259-988d-8667225cf8c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb2b9b5d-640a-401a-ac60-566b6d8dbc52", "tag": "a2903b13-fffc-4e5f-9a12-4bcb585327dd"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:31:44.649237 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:31:44.649237 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:31:44.683758 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-928325c8-a226-40f0-9b98-07ea9740bfe5 req-b51b645e-f8ea-4259-988d-8667225cf8c0 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:44.685120 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-928325c8-a226-40f0-9b98-07ea9740bfe5 req-b51b645e-f8ea-4259-988d-8667225cf8c0 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:44.753253 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-928325c8-a226-40f0-9b98-07ea9740bfe5 req-b51b645e-f8ea-4259-988d-8667225cf8c0 service nova] Creating event network-changed:a2903b13-fffc-4e5f-9a12-4bcb585327dd for instance cb2b9b5d-640a-401a-ac60-566b6d8dbc52 on hv-cinder-84037 May 03 21:31:44.768775 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-928325c8-a226-40f0-9b98-07ea9740bfe5 req-b51b645e-f8ea-4259-988d-8667225cf8c0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.319927 May 03 21:31:44.777726 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 189/406] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:31:44.817781 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-77796259-14d2-4758-885e-eaf3259b47bd tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:44.818927 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-77796259-14d2-4758-885e-eaf3259b47bd tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: b5b63d26-d36d-440d-9107-9d20ffc97ecf] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:45.023637 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-e7334d34-18e2-431b-8996-b8863f2a6d1a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:45.052291 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-e7334d34-18e2-431b-8996-b8863f2a6d1a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:45.059213 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-e7334d34-18e2-431b-8996-b8863f2a6d1a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:45.069026 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-e7334d34-18e2-431b-8996-b8863f2a6d1a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1739 microversion: 2.20 time: 1.048924 May 03 21:31:45.077415 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 218/407] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:44 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1739 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:31:45.092841 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-7e61cf07-a486-4895-a7f8-bdf4fe3d860b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:45.099706 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-7e61cf07-a486-4895-a7f8-bdf4fe3d860b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:45.112471 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7e61cf07-a486-4895-a7f8-bdf4fe3d860b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:45.121190 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7e61cf07-a486-4895-a7f8-bdf4fe3d860b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:45.122294 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7e61cf07-a486-4895-a7f8-bdf4fe3d860b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:45.122956 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7e61cf07-a486-4895-a7f8-bdf4fe3d860b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:45.182995 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-77796259-14d2-4758-885e-eaf3259b47bd tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:45.202249 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-77796259-14d2-4758-885e-eaf3259b47bd tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf" status: 200 len: 1214 microversion: 2.1 time: 0.417626 May 03 21:31:45.204768 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 190/408] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:44 2022] GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf => generated 1214 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:45.858327 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-7e61cf07-a486-4895-a7f8-bdf4fe3d860b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:45.889196 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-7e61cf07-a486-4895-a7f8-bdf4fe3d860b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1708 microversion: 2.1 time: 0.809461 May 03 21:31:45.889932 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 219/409] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:45 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1708 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:46.028224 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-b03c019b-a525-44ac-9c60-22d48a00f252 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:46.034080 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-b03c019b-a525-44ac-9c60-22d48a00f252 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 71fcec7c-c868-4296-b92d-704179c12e86] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:46.074089 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b03c019b-a525-44ac-9c60-22d48a00f252 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:46.074089 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b03c019b-a525-44ac-9c60-22d48a00f252 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:46.074263 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b03c019b-a525-44ac-9c60-22d48a00f252 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:46.075871 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b03c019b-a525-44ac-9c60-22d48a00f252 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:46.137524 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-c8df2741-a0e5-4d41-b712-59f1b33634e9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:46.142370 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-c8df2741-a0e5-4d41-b712-59f1b33634e9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:46.159140 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c8df2741-a0e5-4d41-b712-59f1b33634e9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:46.163134 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c8df2741-a0e5-4d41-b712-59f1b33634e9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:46.166299 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c8df2741-a0e5-4d41-b712-59f1b33634e9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:46.182781 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c8df2741-a0e5-4d41-b712-59f1b33634e9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:46.277913 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-b03c019b-a525-44ac-9c60-22d48a00f252 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 71fcec7c-c868-4296-b92d-704179c12e86] Going to try to terminate instance {{(pid=97831) delete /opt/stack/nova/nova/compute/api.py:2559}} May 03 21:31:46.705472 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-c8df2741-a0e5-4d41-b712-59f1b33634e9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:46.730308 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-c8df2741-a0e5-4d41-b712-59f1b33634e9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:46.737685 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-c8df2741-a0e5-4d41-b712-59f1b33634e9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:46.739797 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-c8df2741-a0e5-4d41-b712-59f1b33634e9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1739 microversion: 2.20 time: 0.645794 May 03 21:31:46.740350 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 220/410] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:46 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1739 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:31:46.799688 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-4587bcdf-284c-44bf-9efe-7aa2f62ba7f8 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:46.800729 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-4587bcdf-284c-44bf-9efe-7aa2f62ba7f8 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: b5b63d26-d36d-440d-9107-9d20ffc97ecf] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:46.813951 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4587bcdf-284c-44bf-9efe-7aa2f62ba7f8 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:46.814809 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4587bcdf-284c-44bf-9efe-7aa2f62ba7f8 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:46.816573 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4587bcdf-284c-44bf-9efe-7aa2f62ba7f8 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:46.817306 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4587bcdf-284c-44bf-9efe-7aa2f62ba7f8 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:46.884020 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-b03c019b-a525-44ac-9c60-22d48a00f252 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "DELETE /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86" status: 204 len: 0 microversion: 2.1 time: 0.874983 May 03 21:31:46.889360 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 191/411] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 3 21:31:46 2022] DELETE /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86 => generated 0 bytes in 879 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 03 21:31:46.913899 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-b645a67a-3506-4583-9d19-a68fb4b1a37f tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:46.915514 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-b645a67a-3506-4583-9d19-a68fb4b1a37f tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 71fcec7c-c868-4296-b92d-704179c12e86] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:46.930324 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b645a67a-3506-4583-9d19-a68fb4b1a37f tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:46.932391 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b645a67a-3506-4583-9d19-a68fb4b1a37f tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:46.934566 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b645a67a-3506-4583-9d19-a68fb4b1a37f tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:46.935277 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b645a67a-3506-4583-9d19-a68fb4b1a37f tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:47.006984 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-4587bcdf-284c-44bf-9efe-7aa2f62ba7f8 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:47.028055 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-4587bcdf-284c-44bf-9efe-7aa2f62ba7f8 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf" status: 200 len: 1210 microversion: 2.1 time: 0.244359 May 03 21:31:47.028055 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 221/412] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:46 2022] GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf => generated 1210 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:47.040098 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-7ff3739f-f788-4a95-9523-488dc4b9f7ad tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:47.041019 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-7ff3739f-f788-4a95-9523-488dc4b9f7ad tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:47.050908 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7ff3739f-f788-4a95-9523-488dc4b9f7ad tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:47.051639 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7ff3739f-f788-4a95-9523-488dc4b9f7ad tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:47.052630 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7ff3739f-f788-4a95-9523-488dc4b9f7ad tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:47.053284 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7ff3739f-f788-4a95-9523-488dc4b9f7ad tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:47.544209 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-7ff3739f-f788-4a95-9523-488dc4b9f7ad tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:47.565822 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-7ff3739f-f788-4a95-9523-488dc4b9f7ad tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1708 microversion: 2.1 time: 0.534968 May 03 21:31:47.576479 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 222/413] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:47 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1708 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:47.786807 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-3457e57b-2d23-48cb-965e-ff524d418e96 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:47.787907 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-3457e57b-2d23-48cb-965e-ff524d418e96 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:47.811733 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3457e57b-2d23-48cb-965e-ff524d418e96 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:47.812593 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3457e57b-2d23-48cb-965e-ff524d418e96 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:47.815470 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3457e57b-2d23-48cb-965e-ff524d418e96 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:47.820513 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3457e57b-2d23-48cb-965e-ff524d418e96 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:48.278971 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-3457e57b-2d23-48cb-965e-ff524d418e96 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:48.314935 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-3457e57b-2d23-48cb-965e-ff524d418e96 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:48.322601 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-3457e57b-2d23-48cb-965e-ff524d418e96 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:48.323974 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-3457e57b-2d23-48cb-965e-ff524d418e96 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1739 microversion: 2.20 time: 0.563648 May 03 21:31:48.337151 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 223/414] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:47 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1739 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:31:48.353516 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-22cb546e-3d81-458f-9c5d-18a2c5bd6c89 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:48.354557 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-22cb546e-3d81-458f-9c5d-18a2c5bd6c89 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: b5b63d26-d36d-440d-9107-9d20ffc97ecf] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:48.368936 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-22cb546e-3d81-458f-9c5d-18a2c5bd6c89 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:48.369390 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-22cb546e-3d81-458f-9c5d-18a2c5bd6c89 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:48.370524 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-22cb546e-3d81-458f-9c5d-18a2c5bd6c89 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:48.370970 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-22cb546e-3d81-458f-9c5d-18a2c5bd6c89 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:48.532900 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-b645a67a-3506-4583-9d19-a68fb4b1a37f tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:48.555327 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-b645a67a-3506-4583-9d19-a68fb4b1a37f tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86" status: 200 len: 1514 microversion: 2.1 time: 1.661204 May 03 21:31:48.565465 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 192/415] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:46 2022] GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86 => generated 1514 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:48.603510 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-dc0647d8-eb75-4bbb-a17a-0cc037e29a86 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:48.604444 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-dc0647d8-eb75-4bbb-a17a-0cc037e29a86 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:48.617076 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-22cb546e-3d81-458f-9c5d-18a2c5bd6c89 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:48.620217 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-dc0647d8-eb75-4bbb-a17a-0cc037e29a86 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:48.621342 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-dc0647d8-eb75-4bbb-a17a-0cc037e29a86 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:48.622339 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-dc0647d8-eb75-4bbb-a17a-0cc037e29a86 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:48.623052 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-dc0647d8-eb75-4bbb-a17a-0cc037e29a86 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:48.656500 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-22cb546e-3d81-458f-9c5d-18a2c5bd6c89 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf" status: 200 len: 1266 microversion: 2.1 time: 0.312462 May 03 21:31:48.662191 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 224/416] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:48 2022] GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf => generated 1266 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:49.325119 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-dc0647d8-eb75-4bbb-a17a-0cc037e29a86 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:49.334519 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-dc0647d8-eb75-4bbb-a17a-0cc037e29a86 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1708 microversion: 2.1 time: 0.745681 May 03 21:31:49.335071 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 193/417] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:48 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1708 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:49.350219 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-dafee50c-efcf-4f82-bad3-140d2aa0a06a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:49.351745 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-dafee50c-efcf-4f82-bad3-140d2aa0a06a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:49.360253 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-dafee50c-efcf-4f82-bad3-140d2aa0a06a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:49.361449 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-dafee50c-efcf-4f82-bad3-140d2aa0a06a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:49.363260 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-dafee50c-efcf-4f82-bad3-140d2aa0a06a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:49.364042 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-dafee50c-efcf-4f82-bad3-140d2aa0a06a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:49.586793 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-32293263-739b-4bee-91c6-3287614e4ab2 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:49.589158 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-32293263-739b-4bee-91c6-3287614e4ab2 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 71fcec7c-c868-4296-b92d-704179c12e86] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:49.602469 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-32293263-739b-4bee-91c6-3287614e4ab2 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:49.602469 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-32293263-739b-4bee-91c6-3287614e4ab2 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:49.606397 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-32293263-739b-4bee-91c6-3287614e4ab2 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:49.607528 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-32293263-739b-4bee-91c6-3287614e4ab2 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:49.806526 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-dafee50c-efcf-4f82-bad3-140d2aa0a06a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:49.828791 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-dafee50c-efcf-4f82-bad3-140d2aa0a06a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:49.841279 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-dafee50c-efcf-4f82-bad3-140d2aa0a06a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:49.842732 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-dafee50c-efcf-4f82-bad3-140d2aa0a06a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1739 microversion: 2.20 time: 0.503959 May 03 21:31:49.856658 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 225/418] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:49 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1739 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:31:49.869160 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-73683006-21dd-4b5a-942a-95fd32be9844 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:49.870054 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-73683006-21dd-4b5a-942a-95fd32be9844 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: b5b63d26-d36d-440d-9107-9d20ffc97ecf] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:49.878501 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-73683006-21dd-4b5a-942a-95fd32be9844 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:49.878950 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-73683006-21dd-4b5a-942a-95fd32be9844 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:49.879876 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-73683006-21dd-4b5a-942a-95fd32be9844 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:49.880314 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-73683006-21dd-4b5a-942a-95fd32be9844 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:50.045552 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-73683006-21dd-4b5a-942a-95fd32be9844 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:50.056485 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-73683006-21dd-4b5a-942a-95fd32be9844 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf" status: 200 len: 1272 microversion: 2.1 time: 0.197539 May 03 21:31:50.067194 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 226/419] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:49 2022] GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf => generated 1272 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:50.363420 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-0146377e-288f-4c08-80e4-93fbf959333f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:50.363420 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-0146377e-288f-4c08-80e4-93fbf959333f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:50.375172 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0146377e-288f-4c08-80e4-93fbf959333f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:50.376177 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0146377e-288f-4c08-80e4-93fbf959333f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:50.377218 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0146377e-288f-4c08-80e4-93fbf959333f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:50.378560 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0146377e-288f-4c08-80e4-93fbf959333f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:50.417290 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-32293263-739b-4bee-91c6-3287614e4ab2 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:50.435502 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-32293263-739b-4bee-91c6-3287614e4ab2 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86" status: 200 len: 1514 microversion: 2.1 time: 0.865942 May 03 21:31:50.440753 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 194/420] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:49 2022] GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86 => generated 1514 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:31:50.751570 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-0146377e-288f-4c08-80e4-93fbf959333f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:50.781121 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-0146377e-288f-4c08-80e4-93fbf959333f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1712 microversion: 2.1 time: 0.431976 May 03 21:31:50.792466 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 227/421] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:50 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1712 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:50.869334 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-ffc060b7-ce8e-40ab-aa9f-0e3c725386b9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:50.870207 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-ffc060b7-ce8e-40ab-aa9f-0e3c725386b9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:50.900923 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ffc060b7-ce8e-40ab-aa9f-0e3c725386b9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:50.902491 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ffc060b7-ce8e-40ab-aa9f-0e3c725386b9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:50.903650 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ffc060b7-ce8e-40ab-aa9f-0e3c725386b9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:50.904282 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ffc060b7-ce8e-40ab-aa9f-0e3c725386b9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:51.101644 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-623f0646-a62c-4675-a331-58e37113135f tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:51.108037 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-623f0646-a62c-4675-a331-58e37113135f tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: b5b63d26-d36d-440d-9107-9d20ffc97ecf] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:51.127259 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-623f0646-a62c-4675-a331-58e37113135f tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:51.136844 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-623f0646-a62c-4675-a331-58e37113135f tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:51.136844 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-623f0646-a62c-4675-a331-58e37113135f tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:51.136844 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-623f0646-a62c-4675-a331-58e37113135f tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:51.376080 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-623f0646-a62c-4675-a331-58e37113135f tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:51.392007 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-623f0646-a62c-4675-a331-58e37113135f tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf" status: 200 len: 1272 microversion: 2.1 time: 0.317632 May 03 21:31:51.414160 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 228/422] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:51 2022] GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf => generated 1272 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:51.477032 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-708feaa2-e2d4-4280-b1ba-95c9fe372a1d tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:51.477596 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-708feaa2-e2d4-4280-b1ba-95c9fe372a1d tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 71fcec7c-c868-4296-b92d-704179c12e86] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:51.493631 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-708feaa2-e2d4-4280-b1ba-95c9fe372a1d tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:51.494084 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-708feaa2-e2d4-4280-b1ba-95c9fe372a1d tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:51.495142 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-708feaa2-e2d4-4280-b1ba-95c9fe372a1d tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:51.495569 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-708feaa2-e2d4-4280-b1ba-95c9fe372a1d tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:51.823667 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-ffc060b7-ce8e-40ab-aa9f-0e3c725386b9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:51.826768 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-708feaa2-e2d4-4280-b1ba-95c9fe372a1d tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:51.839750 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-708feaa2-e2d4-4280-b1ba-95c9fe372a1d tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86" status: 200 len: 1514 microversion: 2.1 time: 0.381941 May 03 21:31:51.840576 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 229/423] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:51 2022] GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86 => generated 1514 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:31:51.842570 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-ffc060b7-ce8e-40ab-aa9f-0e3c725386b9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:51.849797 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-ffc060b7-ce8e-40ab-aa9f-0e3c725386b9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:51.851752 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-ffc060b7-ce8e-40ab-aa9f-0e3c725386b9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1739 microversion: 2.20 time: 0.992585 May 03 21:31:51.852963 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 195/424] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:50 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1739 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:31:52.440717 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-215b4c58-bde9-4907-ae8d-933832cc23bf tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:52.441375 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-215b4c58-bde9-4907-ae8d-933832cc23bf tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: b5b63d26-d36d-440d-9107-9d20ffc97ecf] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:52.450142 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-215b4c58-bde9-4907-ae8d-933832cc23bf tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:52.453211 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-215b4c58-bde9-4907-ae8d-933832cc23bf tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:52.453211 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-215b4c58-bde9-4907-ae8d-933832cc23bf tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:52.453211 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-215b4c58-bde9-4907-ae8d-933832cc23bf tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:52.819187 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-215b4c58-bde9-4907-ae8d-933832cc23bf tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:52.833484 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-215b4c58-bde9-4907-ae8d-933832cc23bf tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf" status: 200 len: 1314 microversion: 2.1 time: 0.402090 May 03 21:31:52.834627 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 230/425] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:52 2022] GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:52.874173 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-01d802fa-76df-43d8-a586-4fd2a7c2a197 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:52.875696 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-01d802fa-76df-43d8-a586-4fd2a7c2a197 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 71fcec7c-c868-4296-b92d-704179c12e86] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:52.877285 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-6e0ef9bb-9438-4cf8-8f52-2828ab0609b5 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:52.877905 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-6e0ef9bb-9438-4cf8-8f52-2828ab0609b5 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:52.884909 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-01d802fa-76df-43d8-a586-4fd2a7c2a197 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:52.885986 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-01d802fa-76df-43d8-a586-4fd2a7c2a197 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:52.887297 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-01d802fa-76df-43d8-a586-4fd2a7c2a197 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:52.888007 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-01d802fa-76df-43d8-a586-4fd2a7c2a197 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:52.896303 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6e0ef9bb-9438-4cf8-8f52-2828ab0609b5 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:52.897302 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6e0ef9bb-9438-4cf8-8f52-2828ab0609b5 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:52.898120 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6e0ef9bb-9438-4cf8-8f52-2828ab0609b5 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:52.898569 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6e0ef9bb-9438-4cf8-8f52-2828ab0609b5 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:53.270422 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-6e0ef9bb-9438-4cf8-8f52-2828ab0609b5 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:53.290775 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-6e0ef9bb-9438-4cf8-8f52-2828ab0609b5 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:53.299360 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-6e0ef9bb-9438-4cf8-8f52-2828ab0609b5 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:53.301431 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-6e0ef9bb-9438-4cf8-8f52-2828ab0609b5 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1739 microversion: 2.20 time: 0.433823 May 03 21:31:53.304108 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 231/426] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:52 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1739 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:31:53.318960 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-03478ad6-f823-4735-9245-74a8d096e6b1 req-e4174573-34bd-4328-814f-8fb9ad174ac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71fcec7c-c868-4296-b92d-704179c12e86", "name": "network-vif-deleted", "tag": "846556a2-6669-4bf4-8f43-d938bc645197"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:31:53.328201 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:31:53.328201 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:31:53.340759 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-03478ad6-f823-4735-9245-74a8d096e6b1 req-e4174573-34bd-4328-814f-8fb9ad174ac6 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:53.341616 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-03478ad6-f823-4735-9245-74a8d096e6b1 req-e4174573-34bd-4328-814f-8fb9ad174ac6 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:53.371531 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-03478ad6-f823-4735-9245-74a8d096e6b1 req-e4174573-34bd-4328-814f-8fb9ad174ac6 service nova] Creating event network-vif-deleted:846556a2-6669-4bf4-8f43-d938bc645197 for instance 71fcec7c-c868-4296-b92d-704179c12e86 on hv-cinder-84037 May 03 21:31:53.379693 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-03478ad6-f823-4735-9245-74a8d096e6b1 req-e4174573-34bd-4328-814f-8fb9ad174ac6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075098 May 03 21:31:53.381789 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 232/427] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:31:53.420066 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-01d802fa-76df-43d8-a586-4fd2a7c2a197 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:53.441532 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-01d802fa-76df-43d8-a586-4fd2a7c2a197 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86" status: 200 len: 1472 microversion: 2.1 time: 0.586749 May 03 21:31:53.452608 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 196/428] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:52 2022] GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86 => generated 1472 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:53.888193 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-097b757f-2f9d-4f6a-88c8-cbf664ac58ab tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:53.889129 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-097b757f-2f9d-4f6a-88c8-cbf664ac58ab tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: b5b63d26-d36d-440d-9107-9d20ffc97ecf] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:53.897011 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-097b757f-2f9d-4f6a-88c8-cbf664ac58ab tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:53.897500 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-097b757f-2f9d-4f6a-88c8-cbf664ac58ab tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:53.899041 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-097b757f-2f9d-4f6a-88c8-cbf664ac58ab tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:53.899484 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-097b757f-2f9d-4f6a-88c8-cbf664ac58ab tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:54.144130 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-097b757f-2f9d-4f6a-88c8-cbf664ac58ab tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:54.154152 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-097b757f-2f9d-4f6a-88c8-cbf664ac58ab tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf" status: 200 len: 1314 microversion: 2.1 time: 0.280821 May 03 21:31:54.154152 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 233/429] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:53 2022] GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:54.331092 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-6f1f93c0-b796-4c55-98f9-517cbe85a72e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:54.332331 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-6f1f93c0-b796-4c55-98f9-517cbe85a72e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:54.340507 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6f1f93c0-b796-4c55-98f9-517cbe85a72e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:54.340977 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6f1f93c0-b796-4c55-98f9-517cbe85a72e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:54.341735 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6f1f93c0-b796-4c55-98f9-517cbe85a72e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:54.342165 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6f1f93c0-b796-4c55-98f9-517cbe85a72e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:54.471864 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-ab69fb22-c8b9-4434-a3f7-a0aa1345c4b6 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:54.472912 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-ab69fb22-c8b9-4434-a3f7-a0aa1345c4b6 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 71fcec7c-c868-4296-b92d-704179c12e86] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:54.481835 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ab69fb22-c8b9-4434-a3f7-a0aa1345c4b6 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:54.482388 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ab69fb22-c8b9-4434-a3f7-a0aa1345c4b6 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:54.483246 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ab69fb22-c8b9-4434-a3f7-a0aa1345c4b6 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:54.484396 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ab69fb22-c8b9-4434-a3f7-a0aa1345c4b6 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:54.568655 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ab69fb22-c8b9-4434-a3f7-a0aa1345c4b6 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:54.569610 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ab69fb22-c8b9-4434-a3f7-a0aa1345c4b6 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:54.569610 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.objects.instance [None req-ab69fb22-c8b9-4434-a3f7-a0aa1345c4b6 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lazy-loading 'fault' on Instance uuid 71fcec7c-c868-4296-b92d-704179c12e86 {{(pid=97832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 03 21:31:54.642205 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-ab69fb22-c8b9-4434-a3f7-a0aa1345c4b6 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:54.651588 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-ab69fb22-c8b9-4434-a3f7-a0aa1345c4b6 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86" status: 200 len: 1308 microversion: 2.1 time: 0.189457 May 03 21:31:54.652156 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 234/430] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:54 2022] GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86 => generated 1308 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:54.741010 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-6f1f93c0-b796-4c55-98f9-517cbe85a72e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:54.757602 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-6f1f93c0-b796-4c55-98f9-517cbe85a72e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:54.770790 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-6f1f93c0-b796-4c55-98f9-517cbe85a72e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:54.771213 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-6f1f93c0-b796-4c55-98f9-517cbe85a72e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1739 microversion: 2.20 time: 0.451558 May 03 21:31:54.772147 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 197/431] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:54 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1739 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:31:55.181934 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-56cfbbc4-ffee-4745-a2ed-f7cd5517891d tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:55.182953 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-56cfbbc4-ffee-4745-a2ed-f7cd5517891d tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: b5b63d26-d36d-440d-9107-9d20ffc97ecf] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:55.202446 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-56cfbbc4-ffee-4745-a2ed-f7cd5517891d tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:55.203879 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-56cfbbc4-ffee-4745-a2ed-f7cd5517891d tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:55.204701 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-56cfbbc4-ffee-4745-a2ed-f7cd5517891d tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:55.205134 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-56cfbbc4-ffee-4745-a2ed-f7cd5517891d tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:55.459853 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-8e7f1364-a005-49da-bc38-b556cb65a0f0 req-77263c69-cc38-43df-bdac-c3baa1c70f6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5b63d26-d36d-440d-9107-9d20ffc97ecf", "tag": "b61db19e-8de7-4a39-bc38-19e6f5760287"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:31:55.467608 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:31:55.467608 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:31:55.476762 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-8e7f1364-a005-49da-bc38-b556cb65a0f0 req-77263c69-cc38-43df-bdac-c3baa1c70f6c service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:55.477432 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-8e7f1364-a005-49da-bc38-b556cb65a0f0 req-77263c69-cc38-43df-bdac-c3baa1c70f6c service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:55.499742 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-8e7f1364-a005-49da-bc38-b556cb65a0f0 req-77263c69-cc38-43df-bdac-c3baa1c70f6c service nova] Creating event network-changed:b61db19e-8de7-4a39-bc38-19e6f5760287 for instance b5b63d26-d36d-440d-9107-9d20ffc97ecf on hv-cinder-84037 May 03 21:31:55.504604 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-8e7f1364-a005-49da-bc38-b556cb65a0f0 req-77263c69-cc38-43df-bdac-c3baa1c70f6c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055526 May 03 21:31:55.505589 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 198/432] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:31:55.583178 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-56cfbbc4-ffee-4745-a2ed-f7cd5517891d tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:55.592582 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-56cfbbc4-ffee-4745-a2ed-f7cd5517891d tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf" status: 200 len: 1314 microversion: 2.1 time: 0.423991 May 03 21:31:55.601828 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 235/433] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:55 2022] GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:31:55.675767 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-8dfd6e76-32c6-4721-93ec-c6256dfb9f1b tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:55.676699 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-8dfd6e76-32c6-4721-93ec-c6256dfb9f1b tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 71fcec7c-c868-4296-b92d-704179c12e86] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:55.685163 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8dfd6e76-32c6-4721-93ec-c6256dfb9f1b tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:55.685401 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8dfd6e76-32c6-4721-93ec-c6256dfb9f1b tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:55.686201 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8dfd6e76-32c6-4721-93ec-c6256dfb9f1b tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:55.686736 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8dfd6e76-32c6-4721-93ec-c6256dfb9f1b tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:55.743568 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.wsgi [None req-8dfd6e76-32c6-4721-93ec-c6256dfb9f1b tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] HTTP exception thrown: Instance 71fcec7c-c868-4296-b92d-704179c12e86 could not be found. May 03 21:31:55.744103 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-8dfd6e76-32c6-4721-93ec-c6256dfb9f1b tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Returning 404 to user: Instance 71fcec7c-c868-4296-b92d-704179c12e86 could not be found. {{(pid=97831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:31:55.745244 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-8dfd6e76-32c6-4721-93ec-c6256dfb9f1b tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86" status: 404 len: 111 microversion: 2.1 time: 0.079257 May 03 21:31:55.746028 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 199/434] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:55 2022] GET /compute/v2.1/servers/71fcec7c-c868-4296-b92d-704179c12e86 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 21:31:55.807136 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-d4cb9edd-f655-40ad-a7cf-131b29025fe6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:55.807957 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-d4cb9edd-f655-40ad-a7cf-131b29025fe6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:55.816205 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d4cb9edd-f655-40ad-a7cf-131b29025fe6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:55.816780 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d4cb9edd-f655-40ad-a7cf-131b29025fe6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:55.817592 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d4cb9edd-f655-40ad-a7cf-131b29025fe6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:55.818025 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d4cb9edd-f655-40ad-a7cf-131b29025fe6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:56.057657 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-d4cb9edd-f655-40ad-a7cf-131b29025fe6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:56.080210 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-d4cb9edd-f655-40ad-a7cf-131b29025fe6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:56.091699 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-d4cb9edd-f655-40ad-a7cf-131b29025fe6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:56.093186 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-d4cb9edd-f655-40ad-a7cf-131b29025fe6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1721 microversion: 2.20 time: 0.296544 May 03 21:31:56.093925 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 236/435] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:55 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1721 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:31:56.618755 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-648812c2-97ab-42d0-b28d-a9bc7582aded tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:56.620109 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-648812c2-97ab-42d0-b28d-a9bc7582aded tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: b5b63d26-d36d-440d-9107-9d20ffc97ecf] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:56.628247 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-648812c2-97ab-42d0-b28d-a9bc7582aded tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:56.628711 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-648812c2-97ab-42d0-b28d-a9bc7582aded tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:56.630483 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-648812c2-97ab-42d0-b28d-a9bc7582aded tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:56.631143 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-648812c2-97ab-42d0-b28d-a9bc7582aded tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:57.122803 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-399be41c-e119-4450-bd4e-29fed3d3d112 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:57.123621 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-399be41c-e119-4450-bd4e-29fed3d3d112 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:57.131318 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-399be41c-e119-4450-bd4e-29fed3d3d112 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:57.132318 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-399be41c-e119-4450-bd4e-29fed3d3d112 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:57.133141 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-399be41c-e119-4450-bd4e-29fed3d3d112 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:57.133606 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-399be41c-e119-4450-bd4e-29fed3d3d112 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:57.322719 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-648812c2-97ab-42d0-b28d-a9bc7582aded tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:57.332902 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-648812c2-97ab-42d0-b28d-a9bc7582aded tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf" status: 200 len: 1314 microversion: 2.1 time: 0.725851 May 03 21:31:57.333466 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 200/436] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:56 2022] GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf => generated 1314 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:57.371254 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-399be41c-e119-4450-bd4e-29fed3d3d112 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:57.386132 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-399be41c-e119-4450-bd4e-29fed3d3d112 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:57.392119 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-399be41c-e119-4450-bd4e-29fed3d3d112 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:57.393270 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-399be41c-e119-4450-bd4e-29fed3d3d112 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1721 microversion: 2.20 time: 0.281041 May 03 21:31:57.393791 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 237/437] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:57 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1721 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:31:58.356698 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-ff5dd692-7d27-4a69-b522-88c02ffabee4 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:58.357316 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-ff5dd692-7d27-4a69-b522-88c02ffabee4 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: b5b63d26-d36d-440d-9107-9d20ffc97ecf] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:58.364788 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ff5dd692-7d27-4a69-b522-88c02ffabee4 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:58.365242 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ff5dd692-7d27-4a69-b522-88c02ffabee4 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:58.366027 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ff5dd692-7d27-4a69-b522-88c02ffabee4 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:58.366714 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ff5dd692-7d27-4a69-b522-88c02ffabee4 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:58.417461 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-36fc9c34-9e3a-4830-89f2-526644a35686 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:58.418024 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-36fc9c34-9e3a-4830-89f2-526644a35686 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:58.425630 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-36fc9c34-9e3a-4830-89f2-526644a35686 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:58.426071 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-36fc9c34-9e3a-4830-89f2-526644a35686 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:58.426852 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-36fc9c34-9e3a-4830-89f2-526644a35686 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:58.427280 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-36fc9c34-9e3a-4830-89f2-526644a35686 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:58.584359 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-ff5dd692-7d27-4a69-b522-88c02ffabee4 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:58.594025 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-ff5dd692-7d27-4a69-b522-88c02ffabee4 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf" status: 200 len: 1314 microversion: 2.1 time: 0.247158 May 03 21:31:58.594577 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 201/438] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:58 2022] GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:31:58.697293 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-36fc9c34-9e3a-4830-89f2-526644a35686 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:58.714246 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-36fc9c34-9e3a-4830-89f2-526644a35686 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:58.720362 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-36fc9c34-9e3a-4830-89f2-526644a35686 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:31:58.721513 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-36fc9c34-9e3a-4830-89f2-526644a35686 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1721 microversion: 2.20 time: 0.313318 May 03 21:31:58.722045 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 238/439] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:58 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1721 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 21:31:59.621958 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-6729c09b-b87a-4a5a-901a-00d1b039f5d6 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:59.622597 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-6729c09b-b87a-4a5a-901a-00d1b039f5d6 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: b5b63d26-d36d-440d-9107-9d20ffc97ecf] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:59.630791 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6729c09b-b87a-4a5a-901a-00d1b039f5d6 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:59.631250 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6729c09b-b87a-4a5a-901a-00d1b039f5d6 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:59.632105 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6729c09b-b87a-4a5a-901a-00d1b039f5d6 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:59.632593 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6729c09b-b87a-4a5a-901a-00d1b039f5d6 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:59.747242 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-401439f7-a807-4908-ac61-0f55cc0e6607 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:31:59.748068 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-401439f7-a807-4908-ac61-0f55cc0e6607 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:31:59.757227 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-401439f7-a807-4908-ac61-0f55cc0e6607 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:59.757913 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-401439f7-a807-4908-ac61-0f55cc0e6607 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:31:59.759111 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-401439f7-a807-4908-ac61-0f55cc0e6607 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:31:59.759347 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-401439f7-a807-4908-ac61-0f55cc0e6607 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:00.009881 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-6729c09b-b87a-4a5a-901a-00d1b039f5d6 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:00.029171 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-6729c09b-b87a-4a5a-901a-00d1b039f5d6 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf" status: 200 len: 1314 microversion: 2.1 time: 0.419174 May 03 21:32:00.029741 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 202/440] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:31:59 2022] GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:32:00.068406 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-401439f7-a807-4908-ac61-0f55cc0e6607 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:00.075203 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-d7f310bc-8896-47d1-b7ec-a290399486de req-9ece96b9-ed3c-45f3-bf5f-d454c3144458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f6a8a2-4366-486d-a002-05587e0f46b5", "name": "network-vif-unplugged", "status": "completed", "tag": "be428a12-3d87-4da1-a665-e7b79df6af66"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:32:00.091759 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-401439f7-a807-4908-ac61-0f55cc0e6607 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:00.098869 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:32:00.098869 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:32:00.099464 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-401439f7-a807-4908-ac61-0f55cc0e6607 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:00.101317 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-401439f7-a807-4908-ac61-0f55cc0e6607 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1721 microversion: 2.20 time: 0.364753 May 03 21:32:00.114944 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 239/441] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:31:59 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1721 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 21:32:00.141443 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-d7f310bc-8896-47d1-b7ec-a290399486de req-9ece96b9-ed3c-45f3-bf5f-d454c3144458 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:00.145616 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-d7f310bc-8896-47d1-b7ec-a290399486de req-9ece96b9-ed3c-45f3-bf5f-d454c3144458 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:00.191095 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-d7f310bc-8896-47d1-b7ec-a290399486de req-9ece96b9-ed3c-45f3-bf5f-d454c3144458 service nova] Creating event network-vif-unplugged:be428a12-3d87-4da1-a665-e7b79df6af66 for instance 77f6a8a2-4366-486d-a002-05587e0f46b5 on hv-cinder-84037 May 03 21:32:00.197598 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-d7f310bc-8896-47d1-b7ec-a290399486de req-9ece96b9-ed3c-45f3-bf5f-d454c3144458 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.166401 May 03 21:32:00.198339 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 203/442] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:32:01.066608 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-2a148219-1f8e-4067-a050-df7789df5880 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:01.067304 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-2a148219-1f8e-4067-a050-df7789df5880 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: b5b63d26-d36d-440d-9107-9d20ffc97ecf] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:01.076943 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2a148219-1f8e-4067-a050-df7789df5880 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:01.077491 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2a148219-1f8e-4067-a050-df7789df5880 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:01.078345 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2a148219-1f8e-4067-a050-df7789df5880 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:01.078872 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2a148219-1f8e-4067-a050-df7789df5880 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:01.128640 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-b90ede3c-4f06-4292-94de-5b41d6d3a85d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:01.129839 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-b90ede3c-4f06-4292-94de-5b41d6d3a85d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:01.137270 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b90ede3c-4f06-4292-94de-5b41d6d3a85d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:01.137726 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b90ede3c-4f06-4292-94de-5b41d6d3a85d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:01.138513 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b90ede3c-4f06-4292-94de-5b41d6d3a85d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:01.138950 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b90ede3c-4f06-4292-94de-5b41d6d3a85d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:01.299473 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-2a148219-1f8e-4067-a050-df7789df5880 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:01.308030 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-2a148219-1f8e-4067-a050-df7789df5880 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf" status: 200 len: 1314 microversion: 2.1 time: 0.255635 May 03 21:32:01.317348 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 240/443] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:01 2022] GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:01.370768 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-b90ede3c-4f06-4292-94de-5b41d6d3a85d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:01.386328 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-b90ede3c-4f06-4292-94de-5b41d6d3a85d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:01.392528 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-b90ede3c-4f06-4292-94de-5b41d6d3a85d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:01.393667 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-b90ede3c-4f06-4292-94de-5b41d6d3a85d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1721 microversion: 2.20 time: 0.275907 May 03 21:32:01.394194 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 204/444] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:32:01 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1721 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:32:02.329734 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-312662f5-d6a5-49e5-9c60-0df6f18d2242 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:02.330361 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-312662f5-d6a5-49e5-9c60-0df6f18d2242 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: b5b63d26-d36d-440d-9107-9d20ffc97ecf] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:02.338135 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-312662f5-d6a5-49e5-9c60-0df6f18d2242 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:02.338587 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-312662f5-d6a5-49e5-9c60-0df6f18d2242 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:02.339423 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-312662f5-d6a5-49e5-9c60-0df6f18d2242 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:02.339853 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-312662f5-d6a5-49e5-9c60-0df6f18d2242 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:02.418220 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-940e7f09-a399-4195-8fc7-36c20161a659 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:02.419586 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-940e7f09-a399-4195-8fc7-36c20161a659 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:02.427043 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-940e7f09-a399-4195-8fc7-36c20161a659 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:02.427501 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-940e7f09-a399-4195-8fc7-36c20161a659 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:02.428279 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-940e7f09-a399-4195-8fc7-36c20161a659 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:02.429606 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-940e7f09-a399-4195-8fc7-36c20161a659 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:02.559964 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-312662f5-d6a5-49e5-9c60-0df6f18d2242 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:02.569277 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-312662f5-d6a5-49e5-9c60-0df6f18d2242 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf" status: 200 len: 1314 microversion: 2.1 time: 0.248103 May 03 21:32:02.569969 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 241/445] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:02 2022] GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:02.878723 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-940e7f09-a399-4195-8fc7-36c20161a659 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:02.893438 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-940e7f09-a399-4195-8fc7-36c20161a659 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:02.900631 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-940e7f09-a399-4195-8fc7-36c20161a659 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:02.901800 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-940e7f09-a399-4195-8fc7-36c20161a659 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1724 microversion: 2.20 time: 0.493722 May 03 21:32:02.902326 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 205/446] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:32:02 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1724 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 21:32:02.928395 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-9017a697-d120-46a3-8ec4-cf92b1b58952 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a164502-7caa-4e0b-a280-4d4f0e1be6a1"}} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:32:02.932368 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-9017a697-d120-46a3-8ec4-cf92b1b58952 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:02.937758 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9017a697-d120-46a3-8ec4-cf92b1b58952 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:02.938260 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9017a697-d120-46a3-8ec4-cf92b1b58952 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:02.939228 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9017a697-d120-46a3-8ec4-cf92b1b58952 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:02.944917 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9017a697-d120-46a3-8ec4-cf92b1b58952 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:03.175415 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-f91738c7-b0b0-4769-8c77-334493f62d63 req-3292ed7d-c71c-449b-bfc9-f31343f28be7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b63d26-d36d-440d-9107-9d20ffc97ecf", "name": "network-vif-plugged", "status": "completed", "tag": "b61db19e-8de7-4a39-bc38-19e6f5760287"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:32:03.185508 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:32:03.185508 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:32:03.196017 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-f91738c7-b0b0-4769-8c77-334493f62d63 req-3292ed7d-c71c-449b-bfc9-f31343f28be7 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:03.196905 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-f91738c7-b0b0-4769-8c77-334493f62d63 req-3292ed7d-c71c-449b-bfc9-f31343f28be7 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:03.217275 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-f91738c7-b0b0-4769-8c77-334493f62d63 req-3292ed7d-c71c-449b-bfc9-f31343f28be7 service nova] Creating event network-vif-plugged:b61db19e-8de7-4a39-bc38-19e6f5760287 for instance b5b63d26-d36d-440d-9107-9d20ffc97ecf on hv-cinder-84037 May 03 21:32:03.223023 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-f91738c7-b0b0-4769-8c77-334493f62d63 req-3292ed7d-c71c-449b-bfc9-f31343f28be7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062962 May 03 21:32:03.223613 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 206/447] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:32:03.594618 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-9539744a-24c0-45b7-9850-2ce6e5766f48 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:03.595596 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-9539744a-24c0-45b7-9850-2ce6e5766f48 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: b5b63d26-d36d-440d-9107-9d20ffc97ecf] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:03.606397 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9539744a-24c0-45b7-9850-2ce6e5766f48 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:03.606845 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9539744a-24c0-45b7-9850-2ce6e5766f48 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:03.608027 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9539744a-24c0-45b7-9850-2ce6e5766f48 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:03.608636 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9539744a-24c0-45b7-9850-2ce6e5766f48 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:03.845745 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-9539744a-24c0-45b7-9850-2ce6e5766f48 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:03.854761 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-9539744a-24c0-45b7-9850-2ce6e5766f48 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf" status: 200 len: 1314 microversion: 2.1 time: 0.270734 May 03 21:32:03.857258 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 207/448] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:03 2022] GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:32:04.594939 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-9017a697-d120-46a3-8ec4-cf92b1b58952 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "POST /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.676345 May 03 21:32:04.595582 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 242/449] 10.222.0.48 () {62 vars in 1363 bytes} [Tue May 3 21:32:02 2022] POST /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5/os-volume_attachments => generated 188 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 03 21:32:04.781229 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-7c4d8dc1-3207-42cf-b090-c08f9b876f3d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:32:04.781826 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-7c4d8dc1-3207-42cf-b090-c08f9b876f3d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:04.789426 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7c4d8dc1-3207-42cf-b090-c08f9b876f3d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:04.789991 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7c4d8dc1-3207-42cf-b090-c08f9b876f3d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:04.790761 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7c4d8dc1-3207-42cf-b090-c08f9b876f3d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:04.791188 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7c4d8dc1-3207-42cf-b090-c08f9b876f3d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:04.887639 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-0f301205-b7db-4b7a-8926-dd36a5396a83 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:04.888247 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-0f301205-b7db-4b7a-8926-dd36a5396a83 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: b5b63d26-d36d-440d-9107-9d20ffc97ecf] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:04.897162 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0f301205-b7db-4b7a-8926-dd36a5396a83 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:04.903332 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0f301205-b7db-4b7a-8926-dd36a5396a83 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:04.903332 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0f301205-b7db-4b7a-8926-dd36a5396a83 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:04.903332 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0f301205-b7db-4b7a-8926-dd36a5396a83 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:05.121777 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-0f301205-b7db-4b7a-8926-dd36a5396a83 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:05.130524 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-0f301205-b7db-4b7a-8926-dd36a5396a83 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf" status: 200 len: 1314 microversion: 2.1 time: 0.257984 May 03 21:32:05.131080 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 243/450] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:04 2022] GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:05.250375 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-7c4d8dc1-3207-42cf-b090-c08f9b876f3d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "POST /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5/action" status: 202 len: 0 microversion: 2.20 time: 0.479212 May 03 21:32:05.250982 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 208/451] 10.222.0.48 () {62 vars in 1318 bytes} [Tue May 3 21:32:04 2022] POST /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5/action => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 03 21:32:05.266442 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-14d3f485-ea28-4461-bf18-dc070ea3231f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:05.266442 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-14d3f485-ea28-4461-bf18-dc070ea3231f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:05.274849 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-14d3f485-ea28-4461-bf18-dc070ea3231f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:05.275290 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-14d3f485-ea28-4461-bf18-dc070ea3231f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:05.284461 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-14d3f485-ea28-4461-bf18-dc070ea3231f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:05.284461 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-14d3f485-ea28-4461-bf18-dc070ea3231f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:05.498252 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-14d3f485-ea28-4461-bf18-dc070ea3231f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:05.513075 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-14d3f485-ea28-4461-bf18-dc070ea3231f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:05.519324 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-14d3f485-ea28-4461-bf18-dc070ea3231f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:05.520448 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-14d3f485-ea28-4461-bf18-dc070ea3231f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1750 microversion: 2.20 time: 0.265106 May 03 21:32:05.521112 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 244/452] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:32:05 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1750 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 21:32:06.154330 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-546ad5bb-3d2e-46dd-a44f-409090734cf8 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:06.154833 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-546ad5bb-3d2e-46dd-a44f-409090734cf8 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: b5b63d26-d36d-440d-9107-9d20ffc97ecf] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:06.163715 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-546ad5bb-3d2e-46dd-a44f-409090734cf8 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:06.163715 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-546ad5bb-3d2e-46dd-a44f-409090734cf8 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:06.164136 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-546ad5bb-3d2e-46dd-a44f-409090734cf8 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:06.164773 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-546ad5bb-3d2e-46dd-a44f-409090734cf8 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:06.395801 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-546ad5bb-3d2e-46dd-a44f-409090734cf8 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:06.404654 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-546ad5bb-3d2e-46dd-a44f-409090734cf8 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf" status: 200 len: 1314 microversion: 2.1 time: 0.260142 May 03 21:32:06.405192 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 209/453] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:06 2022] GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:06.545964 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-fbae6c46-a24c-4f26-8c5b-377bc286a1f4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:06.546568 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-fbae6c46-a24c-4f26-8c5b-377bc286a1f4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:06.555052 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fbae6c46-a24c-4f26-8c5b-377bc286a1f4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:06.555494 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fbae6c46-a24c-4f26-8c5b-377bc286a1f4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:06.556260 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fbae6c46-a24c-4f26-8c5b-377bc286a1f4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:06.556715 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fbae6c46-a24c-4f26-8c5b-377bc286a1f4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:06.807933 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-fbae6c46-a24c-4f26-8c5b-377bc286a1f4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:06.822954 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-fbae6c46-a24c-4f26-8c5b-377bc286a1f4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:06.829778 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-fbae6c46-a24c-4f26-8c5b-377bc286a1f4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:06.831077 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-fbae6c46-a24c-4f26-8c5b-377bc286a1f4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1750 microversion: 2.20 time: 0.295824 May 03 21:32:06.831611 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 245/454] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:32:06 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1750 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:32:07.086742 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-a1197f48-7d2f-45b1-82fc-b891b84619ac tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-495762082", "imageRef": "f5214328-64f1-4aa6-aa05-61f0189e0e1e", "flavorRef": "452", "networks": [{"uuid": "1bd6e5c5-0c32-4b7c-912b-8ae1c3143665"}]}} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:32:07.180093 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.network.neutron [None req-a1197f48-7d2f-45b1-82fc-b891b84619ac tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] validate_networks() for [('1bd6e5c5-0c32-4b7c-912b-8ae1c3143665', None, None, None)] {{(pid=97831) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} May 03 21:32:07.441618 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-baaca246-39b7-4675-924c-029d78c38670 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:07.452931 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-baaca246-39b7-4675-924c-029d78c38670 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: b5b63d26-d36d-440d-9107-9d20ffc97ecf] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:07.477823 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-baaca246-39b7-4675-924c-029d78c38670 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:07.478283 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-baaca246-39b7-4675-924c-029d78c38670 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:07.479075 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-baaca246-39b7-4675-924c-029d78c38670 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:07.479503 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-baaca246-39b7-4675-924c-029d78c38670 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:07.780570 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-a1197f48-7d2f-45b1-82fc-b891b84619ac tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Flavor limits 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} May 03 21:32:07.781169 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-a1197f48-7d2f-45b1-82fc-b891b84619ac tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Image limits 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} May 03 21:32:07.781751 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-a1197f48-7d2f-45b1-82fc-b891b84619ac tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Flavor pref 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} May 03 21:32:07.782238 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-a1197f48-7d2f-45b1-82fc-b891b84619ac tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Image pref 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} May 03 21:32:07.782727 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-a1197f48-7d2f-45b1-82fc-b891b84619ac tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} May 03 21:32:07.793780 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a1197f48-7d2f-45b1-82fc-b891b84619ac tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:07.794230 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a1197f48-7d2f-45b1-82fc-b891b84619ac tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:07.795042 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a1197f48-7d2f-45b1-82fc-b891b84619ac tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:07.795479 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a1197f48-7d2f-45b1-82fc-b891b84619ac tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:07.821250 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-a1197f48-7d2f-45b1-82fc-b891b84619ac tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Getting quotas for project 103e27d9374d41689ceff14ee5a5ae21. Resources: {'instances', 'ram', 'cores'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:32:07.826098 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-a1197f48-7d2f-45b1-82fc-b891b84619ac tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Getting quotas for user 237395ade5344a7eba25fdd620c165f9 and project 103e27d9374d41689ceff14ee5a5ae21. Resources: {'instances', 'ram', 'cores'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:32:07.840985 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-a1197f48-7d2f-45b1-82fc-b891b84619ac tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Going to run 1 instances... {{(pid=97831) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} May 03 21:32:07.845065 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-a1197f48-7d2f-45b1-82fc-b891b84619ac tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5214328-64f1-4aa6-aa05-61f0189e0e1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=97831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} May 03 21:32:07.929477 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-baaca246-39b7-4675-924c-029d78c38670 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:07.938068 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-baaca246-39b7-4675-924c-029d78c38670 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf" status: 200 len: 1314 microversion: 2.1 time: 0.519850 May 03 21:32:07.938866 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 246/455] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:07 2022] GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf => generated 1314 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:32:07.950558 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-677af566-05ad-45a4-a0da-01c3cbf02d7b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:07.951472 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-677af566-05ad-45a4-a0da-01c3cbf02d7b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:07.966540 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-677af566-05ad-45a4-a0da-01c3cbf02d7b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:07.967245 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-677af566-05ad-45a4-a0da-01c3cbf02d7b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:07.971189 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-677af566-05ad-45a4-a0da-01c3cbf02d7b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:07.971189 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-677af566-05ad-45a4-a0da-01c3cbf02d7b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:07.998578 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-a1197f48-7d2f-45b1-82fc-b891b84619ac tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.928837 May 03 21:32:07.999438 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 210/456] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 3 21:32:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 03 21:32:08.021029 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-11b903fe-41c0-4587-8831-bdb90131e361 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:08.021666 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-11b903fe-41c0-4587-8831-bdb90131e361 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:08.130906 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-11b903fe-41c0-4587-8831-bdb90131e361 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:08.140700 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-11b903fe-41c0-4587-8831-bdb90131e361 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6" status: 200 len: 1218 microversion: 2.1 time: 0.135023 May 03 21:32:08.141262 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 211/457] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:08 2022] GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6 => generated 1218 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:08.488495 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-677af566-05ad-45a4-a0da-01c3cbf02d7b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:08.504979 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-677af566-05ad-45a4-a0da-01c3cbf02d7b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:08.511739 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-677af566-05ad-45a4-a0da-01c3cbf02d7b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:08.512909 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-677af566-05ad-45a4-a0da-01c3cbf02d7b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1752 microversion: 2.20 time: 0.572974 May 03 21:32:08.513436 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 247/458] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:32:07 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1752 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:32:08.962280 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-aeb39812-9c7b-4dc5-a3dd-68c40f30c5bb tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:08.962890 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-aeb39812-9c7b-4dc5-a3dd-68c40f30c5bb tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: b5b63d26-d36d-440d-9107-9d20ffc97ecf] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:08.971653 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-aeb39812-9c7b-4dc5-a3dd-68c40f30c5bb tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:08.972320 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-aeb39812-9c7b-4dc5-a3dd-68c40f30c5bb tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:08.973136 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-aeb39812-9c7b-4dc5-a3dd-68c40f30c5bb tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:08.973705 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-aeb39812-9c7b-4dc5-a3dd-68c40f30c5bb tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:09.163716 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-72c4060d-215d-48ff-aa9a-be544cb8fdf1 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:09.164275 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-72c4060d-215d-48ff-aa9a-be544cb8fdf1 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:09.275245 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-aeb39812-9c7b-4dc5-a3dd-68c40f30c5bb tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:09.299190 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-72c4060d-215d-48ff-aa9a-be544cb8fdf1 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:09.313691 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-aeb39812-9c7b-4dc5-a3dd-68c40f30c5bb tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf" status: 200 len: 1498 microversion: 2.1 time: 0.359172 May 03 21:32:09.314894 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 212/459] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:08 2022] GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf => generated 1498 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:09.317879 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-72c4060d-215d-48ff-aa9a-be544cb8fdf1 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6" status: 200 len: 1218 microversion: 2.1 time: 0.163707 May 03 21:32:09.320709 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 248/460] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:09 2022] GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6 => generated 1218 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:09.537539 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-9cbe34d3-a907-49d4-8255-9c788e265cde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:09.538698 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-9cbe34d3-a907-49d4-8255-9c788e265cde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:09.553910 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9cbe34d3-a907-49d4-8255-9c788e265cde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:09.554649 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9cbe34d3-a907-49d4-8255-9c788e265cde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:09.555782 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9cbe34d3-a907-49d4-8255-9c788e265cde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:09.556382 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9cbe34d3-a907-49d4-8255-9c788e265cde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:09.967287 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-9cbe34d3-a907-49d4-8255-9c788e265cde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:09.992780 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-9cbe34d3-a907-49d4-8255-9c788e265cde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:09.999810 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-9cbe34d3-a907-49d4-8255-9c788e265cde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:10.001277 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-9cbe34d3-a907-49d4-8255-9c788e265cde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1752 microversion: 2.20 time: 0.472988 May 03 21:32:10.002285 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 213/461] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:32:09 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1752 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:32:10.344610 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-a67775f8-af5b-4b86-8266-6452f337e519 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:10.345065 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-a67775f8-af5b-4b86-8266-6452f337e519 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:10.361814 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a67775f8-af5b-4b86-8266-6452f337e519 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:10.362250 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a67775f8-af5b-4b86-8266-6452f337e519 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:10.364673 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a67775f8-af5b-4b86-8266-6452f337e519 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:10.365284 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a67775f8-af5b-4b86-8266-6452f337e519 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:10.568861 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-a67775f8-af5b-4b86-8266-6452f337e519 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:10.577616 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-a67775f8-af5b-4b86-8266-6452f337e519 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6" status: 200 len: 1214 microversion: 2.1 time: 0.244898 May 03 21:32:10.578795 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 249/462] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:10 2022] GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6 => generated 1214 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:10.848235 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-bdc42e3f-8b65-4614-a28d-4d0b43e22155 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:10.848769 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-bdc42e3f-8b65-4614-a28d-4d0b43e22155 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: b5b63d26-d36d-440d-9107-9d20ffc97ecf] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:10.856599 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-bdc42e3f-8b65-4614-a28d-4d0b43e22155 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:10.857045 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-bdc42e3f-8b65-4614-a28d-4d0b43e22155 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:10.857811 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-bdc42e3f-8b65-4614-a28d-4d0b43e22155 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:10.858239 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-bdc42e3f-8b65-4614-a28d-4d0b43e22155 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:10.926643 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-bdc42e3f-8b65-4614-a28d-4d0b43e22155 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: b5b63d26-d36d-440d-9107-9d20ffc97ecf] Going to try to terminate instance {{(pid=97831) delete /opt/stack/nova/nova/compute/api.py:2559}} May 03 21:32:11.038773 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-d3392b94-e92c-446a-b531-45ab84515283 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:11.042708 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-d3392b94-e92c-446a-b531-45ab84515283 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:11.058177 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d3392b94-e92c-446a-b531-45ab84515283 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:11.059069 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d3392b94-e92c-446a-b531-45ab84515283 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:11.060391 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d3392b94-e92c-446a-b531-45ab84515283 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:11.060962 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d3392b94-e92c-446a-b531-45ab84515283 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:11.354969 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-bdc42e3f-8b65-4614-a28d-4d0b43e22155 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf" status: 204 len: 0 microversion: 2.1 time: 0.515436 May 03 21:32:11.358907 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 214/463] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 3 21:32:10 2022] DELETE /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf => generated 0 bytes in 517 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 03 21:32:11.359073 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-d3392b94-e92c-446a-b531-45ab84515283 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:11.382959 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-b97b4958-3d55-42b6-800b-5665a7c8089a tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:11.383812 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-b97b4958-3d55-42b6-800b-5665a7c8089a tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: b5b63d26-d36d-440d-9107-9d20ffc97ecf] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:11.393157 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-d3392b94-e92c-446a-b531-45ab84515283 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:11.401546 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-d3392b94-e92c-446a-b531-45ab84515283 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:11.402924 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-d3392b94-e92c-446a-b531-45ab84515283 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1752 microversion: 2.20 time: 0.378807 May 03 21:32:11.409142 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b97b4958-3d55-42b6-800b-5665a7c8089a tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:11.410540 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b97b4958-3d55-42b6-800b-5665a7c8089a tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:11.413852 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 250/464] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:32:11 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1752 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 21:32:11.416106 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b97b4958-3d55-42b6-800b-5665a7c8089a tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:11.416701 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b97b4958-3d55-42b6-800b-5665a7c8089a tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:11.603075 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-05af9ebb-5ad2-4ac2-b052-723dde8a4178 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:11.635232 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-05af9ebb-5ad2-4ac2-b052-723dde8a4178 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:11.680387 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-05af9ebb-5ad2-4ac2-b052-723dde8a4178 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:11.684750 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-05af9ebb-5ad2-4ac2-b052-723dde8a4178 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:11.685663 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-05af9ebb-5ad2-4ac2-b052-723dde8a4178 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:11.686113 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-05af9ebb-5ad2-4ac2-b052-723dde8a4178 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:11.897851 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-05af9ebb-5ad2-4ac2-b052-723dde8a4178 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:11.920194 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-05af9ebb-5ad2-4ac2-b052-723dde8a4178 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6" status: 200 len: 1278 microversion: 2.1 time: 0.327339 May 03 21:32:11.921811 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 251/465] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:11 2022] GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6 => generated 1278 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:32:11.945108 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-b97b4958-3d55-42b6-800b-5665a7c8089a tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:11.965971 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-b97b4958-3d55-42b6-800b-5665a7c8089a tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf" status: 200 len: 1504 microversion: 2.1 time: 0.605588 May 03 21:32:11.966705 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 215/466] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:11 2022] GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf => generated 1504 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:32:12.434572 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-5e3d6b6f-3e44-458a-b5d1-7f2ed840059a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:12.435434 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-5e3d6b6f-3e44-458a-b5d1-7f2ed840059a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:12.448910 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5e3d6b6f-3e44-458a-b5d1-7f2ed840059a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:12.449709 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5e3d6b6f-3e44-458a-b5d1-7f2ed840059a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:12.450858 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5e3d6b6f-3e44-458a-b5d1-7f2ed840059a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:12.451616 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5e3d6b6f-3e44-458a-b5d1-7f2ed840059a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:12.872881 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-5e3d6b6f-3e44-458a-b5d1-7f2ed840059a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:12.890346 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-5e3d6b6f-3e44-458a-b5d1-7f2ed840059a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:12.902684 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-5e3d6b6f-3e44-458a-b5d1-7f2ed840059a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:12.904235 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-5e3d6b6f-3e44-458a-b5d1-7f2ed840059a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1808 microversion: 2.20 time: 0.485645 May 03 21:32:12.908955 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 252/467] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:32:12 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1808 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:32:12.950371 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-2edd2c39-ea67-4d68-bc9e-9141f4cc382d tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:12.951880 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-2edd2c39-ea67-4d68-bc9e-9141f4cc382d tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:12.973843 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2edd2c39-ea67-4d68-bc9e-9141f4cc382d tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:12.974601 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2edd2c39-ea67-4d68-bc9e-9141f4cc382d tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:12.976026 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2edd2c39-ea67-4d68-bc9e-9141f4cc382d tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:12.976928 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2edd2c39-ea67-4d68-bc9e-9141f4cc382d tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:12.990966 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-c255a958-15f7-4419-8a94-c2d6bef4444a tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:12.991870 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-c255a958-15f7-4419-8a94-c2d6bef4444a tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: b5b63d26-d36d-440d-9107-9d20ffc97ecf] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:13.015412 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c255a958-15f7-4419-8a94-c2d6bef4444a tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:13.015857 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c255a958-15f7-4419-8a94-c2d6bef4444a tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:13.016664 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c255a958-15f7-4419-8a94-c2d6bef4444a tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:13.017557 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c255a958-15f7-4419-8a94-c2d6bef4444a tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:13.797751 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-2edd2c39-ea67-4d68-bc9e-9141f4cc382d tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:13.821825 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-2edd2c39-ea67-4d68-bc9e-9141f4cc382d tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6" status: 200 len: 1318 microversion: 2.1 time: 0.883813 May 03 21:32:13.823127 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 216/468] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:12 2022] GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6 => generated 1318 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:13.867737 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-c255a958-15f7-4419-8a94-c2d6bef4444a tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:13.896182 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-c255a958-15f7-4419-8a94-c2d6bef4444a tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf" status: 200 len: 1504 microversion: 2.1 time: 0.914143 May 03 21:32:13.899062 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 253/469] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:12 2022] GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf => generated 1504 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:13.935351 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-96e871b0-ba62-412a-b055-93ac816eceb9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:13.937709 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-96e871b0-ba62-412a-b055-93ac816eceb9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:13.964844 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-96e871b0-ba62-412a-b055-93ac816eceb9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:13.968678 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-96e871b0-ba62-412a-b055-93ac816eceb9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:13.969959 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-96e871b0-ba62-412a-b055-93ac816eceb9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:13.970556 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-96e871b0-ba62-412a-b055-93ac816eceb9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:14.628259 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-96e871b0-ba62-412a-b055-93ac816eceb9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:14.645371 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-96e871b0-ba62-412a-b055-93ac816eceb9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:14.652016 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-96e871b0-ba62-412a-b055-93ac816eceb9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:14.653556 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-96e871b0-ba62-412a-b055-93ac816eceb9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1808 microversion: 2.20 time: 0.734229 May 03 21:32:14.654125 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 217/470] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:32:13 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1808 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:32:14.848285 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-160c63a7-38cc-42cd-8591-425f75b3e216 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:14.851831 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-160c63a7-38cc-42cd-8591-425f75b3e216 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:14.883567 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-160c63a7-38cc-42cd-8591-425f75b3e216 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:14.889159 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-160c63a7-38cc-42cd-8591-425f75b3e216 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:14.890004 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-160c63a7-38cc-42cd-8591-425f75b3e216 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:14.890450 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-160c63a7-38cc-42cd-8591-425f75b3e216 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:14.925646 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-b94316f5-cb0d-4aac-8415-4cda6b287f2d tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:14.926265 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-b94316f5-cb0d-4aac-8415-4cda6b287f2d tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: b5b63d26-d36d-440d-9107-9d20ffc97ecf] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:14.953095 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b94316f5-cb0d-4aac-8415-4cda6b287f2d tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:14.953814 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b94316f5-cb0d-4aac-8415-4cda6b287f2d tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:14.954774 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b94316f5-cb0d-4aac-8415-4cda6b287f2d tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:14.955368 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b94316f5-cb0d-4aac-8415-4cda6b287f2d tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:15.253320 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-160c63a7-38cc-42cd-8591-425f75b3e216 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:15.272980 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-160c63a7-38cc-42cd-8591-425f75b3e216 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6" status: 200 len: 1318 microversion: 2.1 time: 0.435795 May 03 21:32:15.279791 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 254/471] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:14 2022] GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6 => generated 1318 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:15.440054 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-b94316f5-cb0d-4aac-8415-4cda6b287f2d tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:15.451947 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-b94316f5-cb0d-4aac-8415-4cda6b287f2d tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf" status: 200 len: 1504 microversion: 2.1 time: 0.541647 May 03 21:32:15.456460 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 218/472] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:14 2022] GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf => generated 1504 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:32:15.630066 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-fbc47aa3-b767-46bd-86f9-daba5f9a23e8 req-c3da25d2-eaf8-41f7-b42c-4f4e21d69c75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7faa75bc-a237-4850-b9c4-fcd56ac7b0b6", "tag": "3d939f88-ef7f-49d3-beb5-514a56fdf884"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:32:15.637835 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:32:15.637835 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:32:15.654284 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-fbc47aa3-b767-46bd-86f9-daba5f9a23e8 req-c3da25d2-eaf8-41f7-b42c-4f4e21d69c75 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:15.654751 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-fbc47aa3-b767-46bd-86f9-daba5f9a23e8 req-c3da25d2-eaf8-41f7-b42c-4f4e21d69c75 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:15.689554 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-067d36bd-cdd4-4100-9221-d83ff8efb3eb tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:15.692894 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-067d36bd-cdd4-4100-9221-d83ff8efb3eb tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:15.700810 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-fbc47aa3-b767-46bd-86f9-daba5f9a23e8 req-c3da25d2-eaf8-41f7-b42c-4f4e21d69c75 service nova] Creating event network-changed:3d939f88-ef7f-49d3-beb5-514a56fdf884 for instance 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6 on hv-cinder-84037 May 03 21:32:15.714511 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-fbc47aa3-b767-46bd-86f9-daba5f9a23e8 req-c3da25d2-eaf8-41f7-b42c-4f4e21d69c75 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093152 May 03 21:32:15.718066 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-067d36bd-cdd4-4100-9221-d83ff8efb3eb tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:15.719092 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 255/473] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:32:15.719903 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-067d36bd-cdd4-4100-9221-d83ff8efb3eb tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:15.720884 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-067d36bd-cdd4-4100-9221-d83ff8efb3eb tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:15.726371 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-067d36bd-cdd4-4100-9221-d83ff8efb3eb tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:16.122546 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-067d36bd-cdd4-4100-9221-d83ff8efb3eb tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:16.122546 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-067d36bd-cdd4-4100-9221-d83ff8efb3eb tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:16.122899 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-067d36bd-cdd4-4100-9221-d83ff8efb3eb tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:16.122899 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-067d36bd-cdd4-4100-9221-d83ff8efb3eb tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1808 microversion: 2.20 time: 0.371814 May 03 21:32:16.122899 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 219/474] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:32:15 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1808 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 21:32:16.385158 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-e47af8be-6266-471a-a572-94b6f1b5163d tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:16.385158 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-e47af8be-6266-471a-a572-94b6f1b5163d tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:16.385158 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e47af8be-6266-471a-a572-94b6f1b5163d tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:16.385158 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e47af8be-6266-471a-a572-94b6f1b5163d tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:16.385949 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e47af8be-6266-471a-a572-94b6f1b5163d tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:16.385949 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e47af8be-6266-471a-a572-94b6f1b5163d tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:16.482074 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-a52d8832-bdc3-40fe-ad9b-89ee0eb7338e tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:16.487443 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-a52d8832-bdc3-40fe-ad9b-89ee0eb7338e tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: b5b63d26-d36d-440d-9107-9d20ffc97ecf] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:16.507625 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a52d8832-bdc3-40fe-ad9b-89ee0eb7338e tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:16.510335 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a52d8832-bdc3-40fe-ad9b-89ee0eb7338e tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:16.513576 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a52d8832-bdc3-40fe-ad9b-89ee0eb7338e tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:16.516121 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a52d8832-bdc3-40fe-ad9b-89ee0eb7338e tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:16.608100 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-e47af8be-6266-471a-a572-94b6f1b5163d tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:16.619162 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-e47af8be-6266-471a-a572-94b6f1b5163d tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6" status: 200 len: 1318 microversion: 2.1 time: 0.327543 May 03 21:32:16.629393 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 256/475] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:16 2022] GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6 => generated 1318 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:16.896267 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-a52d8832-bdc3-40fe-ad9b-89ee0eb7338e tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:16.910419 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-a52d8832-bdc3-40fe-ad9b-89ee0eb7338e tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf" status: 200 len: 1504 microversion: 2.1 time: 0.443036 May 03 21:32:16.911266 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 220/476] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:16 2022] GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf => generated 1504 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:32:17.143553 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-2f7ee5d1-66f6-44e7-8b6e-7c1a0b1c8775 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:17.144499 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-2f7ee5d1-66f6-44e7-8b6e-7c1a0b1c8775 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:17.152998 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2f7ee5d1-66f6-44e7-8b6e-7c1a0b1c8775 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:17.153729 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2f7ee5d1-66f6-44e7-8b6e-7c1a0b1c8775 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:17.154678 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2f7ee5d1-66f6-44e7-8b6e-7c1a0b1c8775 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:17.155268 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2f7ee5d1-66f6-44e7-8b6e-7c1a0b1c8775 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:17.554527 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-2f7ee5d1-66f6-44e7-8b6e-7c1a0b1c8775 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:17.571537 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-2f7ee5d1-66f6-44e7-8b6e-7c1a0b1c8775 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:17.580233 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-2f7ee5d1-66f6-44e7-8b6e-7c1a0b1c8775 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:17.581565 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-2f7ee5d1-66f6-44e7-8b6e-7c1a0b1c8775 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1808 microversion: 2.20 time: 0.457093 May 03 21:32:17.582458 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 257/477] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:32:17 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1808 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:32:17.641774 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-569137fd-1279-4a0c-a42c-85213ea2bcd7 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:17.642474 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-569137fd-1279-4a0c-a42c-85213ea2bcd7 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:17.657032 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-569137fd-1279-4a0c-a42c-85213ea2bcd7 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:17.657388 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-569137fd-1279-4a0c-a42c-85213ea2bcd7 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:17.658206 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-569137fd-1279-4a0c-a42c-85213ea2bcd7 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:17.658703 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-569137fd-1279-4a0c-a42c-85213ea2bcd7 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:17.945388 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-9c20cf48-6869-4026-ab66-6387b5aa1aee tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:17.946521 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-9c20cf48-6869-4026-ab66-6387b5aa1aee tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: b5b63d26-d36d-440d-9107-9d20ffc97ecf] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:17.959779 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9c20cf48-6869-4026-ab66-6387b5aa1aee tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:17.960642 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9c20cf48-6869-4026-ab66-6387b5aa1aee tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:17.961844 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9c20cf48-6869-4026-ab66-6387b5aa1aee tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:17.962496 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9c20cf48-6869-4026-ab66-6387b5aa1aee tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:18.012400 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-569137fd-1279-4a0c-a42c-85213ea2bcd7 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:18.031205 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-569137fd-1279-4a0c-a42c-85213ea2bcd7 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6" status: 200 len: 1318 microversion: 2.1 time: 0.398664 May 03 21:32:18.032132 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 221/478] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:17 2022] GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6 => generated 1318 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:18.461800 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-9c20cf48-6869-4026-ab66-6387b5aa1aee tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:18.476538 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-9c20cf48-6869-4026-ab66-6387b5aa1aee tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf" status: 200 len: 1504 microversion: 2.1 time: 0.550979 May 03 21:32:18.487735 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 258/479] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:17 2022] GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf => generated 1504 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:18.607461 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-b754d47d-af6a-45e4-9ce7-1177c55e6b41 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:18.607984 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-b754d47d-af6a-45e4-9ce7-1177c55e6b41 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:18.616274 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b754d47d-af6a-45e4-9ce7-1177c55e6b41 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:18.616709 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b754d47d-af6a-45e4-9ce7-1177c55e6b41 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:18.617540 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b754d47d-af6a-45e4-9ce7-1177c55e6b41 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:18.618155 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b754d47d-af6a-45e4-9ce7-1177c55e6b41 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:19.002537 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-b754d47d-af6a-45e4-9ce7-1177c55e6b41 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:19.048741 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-b754d47d-af6a-45e4-9ce7-1177c55e6b41 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:19.048741 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-b754d47d-af6a-45e4-9ce7-1177c55e6b41 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:19.048741 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-b754d47d-af6a-45e4-9ce7-1177c55e6b41 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1808 microversion: 2.20 time: 0.434655 May 03 21:32:19.049090 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 222/480] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:32:18 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1808 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:32:19.074939 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-71997dae-c716-4100-9b84-1bf6e9a49824 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:19.075610 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-71997dae-c716-4100-9b84-1bf6e9a49824 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:19.094479 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-71997dae-c716-4100-9b84-1bf6e9a49824 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:19.094938 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-71997dae-c716-4100-9b84-1bf6e9a49824 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:19.095723 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-71997dae-c716-4100-9b84-1bf6e9a49824 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:19.096156 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-71997dae-c716-4100-9b84-1bf6e9a49824 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:19.400840 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-09e40f78-0362-4062-944e-12f2d12443c8 req-3c318d8e-d893-4ff9-b0bc-20d6467bd135 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b63d26-d36d-440d-9107-9d20ffc97ecf", "name": "network-vif-unplugged", "status": "completed", "tag": "b61db19e-8de7-4a39-bc38-19e6f5760287"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:32:19.409212 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:32:19.409212 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:32:19.421288 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-09e40f78-0362-4062-944e-12f2d12443c8 req-3c318d8e-d893-4ff9-b0bc-20d6467bd135 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:19.422834 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-09e40f78-0362-4062-944e-12f2d12443c8 req-3c318d8e-d893-4ff9-b0bc-20d6467bd135 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:19.448851 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-09e40f78-0362-4062-944e-12f2d12443c8 req-3c318d8e-d893-4ff9-b0bc-20d6467bd135 service nova] Creating event network-vif-unplugged:b61db19e-8de7-4a39-bc38-19e6f5760287 for instance b5b63d26-d36d-440d-9107-9d20ffc97ecf on hv-cinder-84037 May 03 21:32:19.454799 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-09e40f78-0362-4062-944e-12f2d12443c8 req-3c318d8e-d893-4ff9-b0bc-20d6467bd135 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084599 May 03 21:32:19.456679 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 223/481] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:32:19.506224 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-8d03e67e-6840-4170-a69c-b49edb866dae tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:19.509059 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-8d03e67e-6840-4170-a69c-b49edb866dae tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: b5b63d26-d36d-440d-9107-9d20ffc97ecf] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:19.533539 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8d03e67e-6840-4170-a69c-b49edb866dae tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:19.534427 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8d03e67e-6840-4170-a69c-b49edb866dae tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:19.536668 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8d03e67e-6840-4170-a69c-b49edb866dae tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:19.538055 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8d03e67e-6840-4170-a69c-b49edb866dae tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:19.554321 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-71997dae-c716-4100-9b84-1bf6e9a49824 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:19.583170 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-71997dae-c716-4100-9b84-1bf6e9a49824 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6" status: 200 len: 1318 microversion: 2.1 time: 0.537252 May 03 21:32:19.596815 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 259/482] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:19 2022] GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6 => generated 1318 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:19.911165 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-8d03e67e-6840-4170-a69c-b49edb866dae tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:19.934624 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-8d03e67e-6840-4170-a69c-b49edb866dae tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf" status: 200 len: 1504 microversion: 2.1 time: 0.443362 May 03 21:32:19.939525 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 224/483] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:19 2022] GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf => generated 1504 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:20.094420 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-9dda8afe-e9bf-4bce-9cbe-124cec75283a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:20.097223 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-9dda8afe-e9bf-4bce-9cbe-124cec75283a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:20.115712 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9dda8afe-e9bf-4bce-9cbe-124cec75283a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:20.116555 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9dda8afe-e9bf-4bce-9cbe-124cec75283a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:20.117559 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9dda8afe-e9bf-4bce-9cbe-124cec75283a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:20.146366 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9dda8afe-e9bf-4bce-9cbe-124cec75283a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:20.482164 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-9dda8afe-e9bf-4bce-9cbe-124cec75283a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:20.502196 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-9dda8afe-e9bf-4bce-9cbe-124cec75283a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:20.513327 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-9dda8afe-e9bf-4bce-9cbe-124cec75283a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:20.514488 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-9dda8afe-e9bf-4bce-9cbe-124cec75283a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1808 microversion: 2.20 time: 0.465510 May 03 21:32:20.520919 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 260/484] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:32:20 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1808 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:32:20.637719 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-f7f2dc99-3945-4519-87c2-8c2afa84ffe3 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:20.637719 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-f7f2dc99-3945-4519-87c2-8c2afa84ffe3 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:20.637719 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f7f2dc99-3945-4519-87c2-8c2afa84ffe3 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:20.637719 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f7f2dc99-3945-4519-87c2-8c2afa84ffe3 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:20.638913 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f7f2dc99-3945-4519-87c2-8c2afa84ffe3 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:20.638913 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f7f2dc99-3945-4519-87c2-8c2afa84ffe3 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:20.976406 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-914f7ec7-a862-4b42-b2d3-0ff11a7e5549 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:20.984522 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-914f7ec7-a862-4b42-b2d3-0ff11a7e5549 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: b5b63d26-d36d-440d-9107-9d20ffc97ecf] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:20.998167 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-914f7ec7-a862-4b42-b2d3-0ff11a7e5549 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:20.999110 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-914f7ec7-a862-4b42-b2d3-0ff11a7e5549 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:21.000235 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-914f7ec7-a862-4b42-b2d3-0ff11a7e5549 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:21.000862 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-914f7ec7-a862-4b42-b2d3-0ff11a7e5549 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:21.037290 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-f7f2dc99-3945-4519-87c2-8c2afa84ffe3 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:21.083786 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-f7f2dc99-3945-4519-87c2-8c2afa84ffe3 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6" status: 200 len: 1318 microversion: 2.1 time: 0.482543 May 03 21:32:21.089018 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 225/485] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:20 2022] GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6 => generated 1318 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:21.548791 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-363b8ce2-89da-404a-8beb-ed3409b1b3c3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:21.548926 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-363b8ce2-89da-404a-8beb-ed3409b1b3c3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:21.570173 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-363b8ce2-89da-404a-8beb-ed3409b1b3c3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:21.570632 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-363b8ce2-89da-404a-8beb-ed3409b1b3c3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:21.571985 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-363b8ce2-89da-404a-8beb-ed3409b1b3c3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:21.572486 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-363b8ce2-89da-404a-8beb-ed3409b1b3c3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:21.705225 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-914f7ec7-a862-4b42-b2d3-0ff11a7e5549 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:21.729240 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-914f7ec7-a862-4b42-b2d3-0ff11a7e5549 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf" status: 200 len: 1504 microversion: 2.1 time: 0.774662 May 03 21:32:21.730805 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 261/486] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:20 2022] GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf => generated 1504 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:32:22.117721 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-def445f6-505b-4145-a8ca-777204e6b7e2 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:22.121926 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-def445f6-505b-4145-a8ca-777204e6b7e2 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:22.143697 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-def445f6-505b-4145-a8ca-777204e6b7e2 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:22.144145 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-def445f6-505b-4145-a8ca-777204e6b7e2 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:22.145036 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-def445f6-505b-4145-a8ca-777204e6b7e2 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:22.146700 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-def445f6-505b-4145-a8ca-777204e6b7e2 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:22.398017 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-363b8ce2-89da-404a-8beb-ed3409b1b3c3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:22.450921 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-363b8ce2-89da-404a-8beb-ed3409b1b3c3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:22.473133 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-363b8ce2-89da-404a-8beb-ed3409b1b3c3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:22.480775 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-363b8ce2-89da-404a-8beb-ed3409b1b3c3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1808 microversion: 2.20 time: 0.944708 May 03 21:32:22.480775 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 226/487] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:32:21 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1808 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 21:32:22.752591 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-2101c424-7a79-4ec7-8444-43fcab4a342b tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:22.755648 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-2101c424-7a79-4ec7-8444-43fcab4a342b tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: b5b63d26-d36d-440d-9107-9d20ffc97ecf] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:22.778402 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2101c424-7a79-4ec7-8444-43fcab4a342b tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:22.785269 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2101c424-7a79-4ec7-8444-43fcab4a342b tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:22.785269 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2101c424-7a79-4ec7-8444-43fcab4a342b tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:22.785269 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2101c424-7a79-4ec7-8444-43fcab4a342b tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:22.906812 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-def445f6-505b-4145-a8ca-777204e6b7e2 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:22.920782 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-def445f6-505b-4145-a8ca-777204e6b7e2 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6" status: 200 len: 1318 microversion: 2.1 time: 0.820062 May 03 21:32:22.931974 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 262/488] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:22 2022] GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6 => generated 1318 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:32:23.059919 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-2101c424-7a79-4ec7-8444-43fcab4a342b tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:23.081208 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-2101c424-7a79-4ec7-8444-43fcab4a342b tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf" status: 200 len: 1462 microversion: 2.1 time: 0.338196 May 03 21:32:23.082796 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 227/489] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:22 2022] GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf => generated 1462 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:23.504659 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-5cd223da-dbcb-4906-8694-72432df11b30 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:23.515191 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-5cd223da-dbcb-4906-8694-72432df11b30 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:23.524075 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5cd223da-dbcb-4906-8694-72432df11b30 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:23.524838 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5cd223da-dbcb-4906-8694-72432df11b30 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:23.525635 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5cd223da-dbcb-4906-8694-72432df11b30 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:23.526068 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5cd223da-dbcb-4906-8694-72432df11b30 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:23.940523 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-5cd223da-dbcb-4906-8694-72432df11b30 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:23.945807 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-4c8d5f68-91f7-4009-8d69-ae98a36a16d5 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:23.946429 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-4c8d5f68-91f7-4009-8d69-ae98a36a16d5 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:23.953915 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4c8d5f68-91f7-4009-8d69-ae98a36a16d5 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:23.954462 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4c8d5f68-91f7-4009-8d69-ae98a36a16d5 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:23.955365 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4c8d5f68-91f7-4009-8d69-ae98a36a16d5 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:23.956071 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4c8d5f68-91f7-4009-8d69-ae98a36a16d5 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:23.957432 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-5cd223da-dbcb-4906-8694-72432df11b30 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:23.965549 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-5cd223da-dbcb-4906-8694-72432df11b30 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:23.966689 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-5cd223da-dbcb-4906-8694-72432df11b30 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1808 microversion: 2.20 time: 0.475328 May 03 21:32:23.967218 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 263/490] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:32:23 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1808 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:32:24.031450 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-ce2b5021-2ce4-4b9d-b17e-0344017b51e9 req-298c24c1-8298-4a0d-b503-8c397ff7f40e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b63d26-d36d-440d-9107-9d20ffc97ecf", "name": "network-vif-deleted", "tag": "b61db19e-8de7-4a39-bc38-19e6f5760287"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:32:24.044725 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:32:24.044725 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:32:24.066782 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-ce2b5021-2ce4-4b9d-b17e-0344017b51e9 req-298c24c1-8298-4a0d-b503-8c397ff7f40e service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:24.067825 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-ce2b5021-2ce4-4b9d-b17e-0344017b51e9 req-298c24c1-8298-4a0d-b503-8c397ff7f40e service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:24.111740 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-ce2b5021-2ce4-4b9d-b17e-0344017b51e9 req-298c24c1-8298-4a0d-b503-8c397ff7f40e service nova] Creating event network-vif-deleted:b61db19e-8de7-4a39-bc38-19e6f5760287 for instance b5b63d26-d36d-440d-9107-9d20ffc97ecf on hv-cinder-84037 May 03 21:32:24.127779 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-ce2b5021-2ce4-4b9d-b17e-0344017b51e9 req-298c24c1-8298-4a0d-b503-8c397ff7f40e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115860 May 03 21:32:24.133155 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 264/491] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:32:24.159263 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-5be1ccd0-cefe-4a29-9088-2cf50b68a0df tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:24.164459 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-5be1ccd0-cefe-4a29-9088-2cf50b68a0df tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: b5b63d26-d36d-440d-9107-9d20ffc97ecf] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:24.185370 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5be1ccd0-cefe-4a29-9088-2cf50b68a0df tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:24.185370 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5be1ccd0-cefe-4a29-9088-2cf50b68a0df tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:24.185370 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5be1ccd0-cefe-4a29-9088-2cf50b68a0df tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:24.185963 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5be1ccd0-cefe-4a29-9088-2cf50b68a0df tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:24.274544 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-4c8d5f68-91f7-4009-8d69-ae98a36a16d5 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:24.283063 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-4c8d5f68-91f7-4009-8d69-ae98a36a16d5 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6" status: 200 len: 1318 microversion: 2.1 time: 0.347025 May 03 21:32:24.284053 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 228/492] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:23 2022] GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6 => generated 1318 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:32:24.381389 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-5be1ccd0-cefe-4a29-9088-2cf50b68a0df tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce53c9c393cd431aa932c98352644d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2eb47de9ab494c8061632f766f1050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:24.391200 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-5be1ccd0-cefe-4a29-9088-2cf50b68a0df tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf" status: 200 len: 1462 microversion: 2.1 time: 0.256562 May 03 21:32:24.401172 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 265/493] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:24 2022] GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf => generated 1462 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:24.994270 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-f88e2273-7150-4425-af9e-633092eac70d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:24.996357 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-f88e2273-7150-4425-af9e-633092eac70d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:25.013149 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f88e2273-7150-4425-af9e-633092eac70d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:25.013963 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f88e2273-7150-4425-af9e-633092eac70d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:25.014971 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f88e2273-7150-4425-af9e-633092eac70d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:25.015741 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f88e2273-7150-4425-af9e-633092eac70d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:25.111133 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-d41bba77-b4a5-4d4f-bbf8-ad285658b217 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9b7a540-3b03-4517-9746-6799e6107dba"}} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:32:25.119568 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-d41bba77-b4a5-4d4f-bbf8-ad285658b217 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:25.132656 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d41bba77-b4a5-4d4f-bbf8-ad285658b217 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:25.133396 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d41bba77-b4a5-4d4f-bbf8-ad285658b217 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:25.134337 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d41bba77-b4a5-4d4f-bbf8-ad285658b217 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:25.134947 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d41bba77-b4a5-4d4f-bbf8-ad285658b217 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:25.761119 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-f88e2273-7150-4425-af9e-633092eac70d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:25.796833 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-f88e2273-7150-4425-af9e-633092eac70d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:25.817247 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-f88e2273-7150-4425-af9e-633092eac70d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:25.818478 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-f88e2273-7150-4425-af9e-633092eac70d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1808 microversion: 2.20 time: 0.836660 May 03 21:32:25.819868 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 229/494] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:32:24 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1808 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:32:25.851464 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-78135733-bf0e-4565-b52a-24c858052108 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:25.852185 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-78135733-bf0e-4565-b52a-24c858052108 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:25.862738 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-78135733-bf0e-4565-b52a-24c858052108 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:25.863232 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-78135733-bf0e-4565-b52a-24c858052108 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:25.864054 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-78135733-bf0e-4565-b52a-24c858052108 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:25.864508 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-78135733-bf0e-4565-b52a-24c858052108 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:26.372453 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-d41bba77-b4a5-4d4f-bbf8-ad285658b217 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "POST /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.270705 May 03 21:32:26.378945 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 266/495] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 3 21:32:25 2022] POST /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52/os-volume_attachments => generated 194 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:32:26.391370 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-ed5c1283-c173-414e-a740-c3c44b001993 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:26.392185 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-ed5c1283-c173-414e-a740-c3c44b001993 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:26.408036 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ed5c1283-c173-414e-a740-c3c44b001993 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:26.409179 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ed5c1283-c173-414e-a740-c3c44b001993 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:26.410983 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ed5c1283-c173-414e-a740-c3c44b001993 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:26.411706 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ed5c1283-c173-414e-a740-c3c44b001993 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:26.455752 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-78135733-bf0e-4565-b52a-24c858052108 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:26.471725 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-78135733-bf0e-4565-b52a-24c858052108 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6" status: 200 len: 1318 microversion: 2.1 time: 0.645900 May 03 21:32:26.477685 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 230/496] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:25 2022] GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6 => generated 1318 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:26.499300 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-871f438e-730e-4e1b-8f44-5a005ffc69d5 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:26.500861 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-871f438e-730e-4e1b-8f44-5a005ffc69d5 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] [instance: b5b63d26-d36d-440d-9107-9d20ffc97ecf] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:26.516151 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-871f438e-730e-4e1b-8f44-5a005ffc69d5 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:26.521001 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-871f438e-730e-4e1b-8f44-5a005ffc69d5 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:26.521851 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-871f438e-730e-4e1b-8f44-5a005ffc69d5 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:26.522481 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-871f438e-730e-4e1b-8f44-5a005ffc69d5 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:26.544075 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-ed5c1283-c173-414e-a740-c3c44b001993 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f/ips" status: 200 len: 148 microversion: 2.1 time: 0.163301 May 03 21:32:26.545309 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 267/497] 10.222.0.48 () {58 vars in 1247 bytes} [Tue May 3 21:32:26 2022] GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f/ips => generated 148 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:32:26.566593 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-17a6855c-7cfa-48db-84d6-3aeac1d9fe19 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34c9d45b-c408-4504-a3cf-4787c0878669"}} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:32:26.570871 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-17a6855c-7cfa-48db-84d6-3aeac1d9fe19 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:26.583615 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-17a6855c-7cfa-48db-84d6-3aeac1d9fe19 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:26.584635 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-17a6855c-7cfa-48db-84d6-3aeac1d9fe19 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:26.589499 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-17a6855c-7cfa-48db-84d6-3aeac1d9fe19 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:26.589499 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-17a6855c-7cfa-48db-84d6-3aeac1d9fe19 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:26.629965 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.wsgi [None req-871f438e-730e-4e1b-8f44-5a005ffc69d5 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] HTTP exception thrown: Instance b5b63d26-d36d-440d-9107-9d20ffc97ecf could not be found. May 03 21:32:26.631989 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-871f438e-730e-4e1b-8f44-5a005ffc69d5 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] Returning 404 to user: Instance b5b63d26-d36d-440d-9107-9d20ffc97ecf could not be found. {{(pid=97831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:32:26.633856 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-871f438e-730e-4e1b-8f44-5a005ffc69d5 tempest-VolumesActionsTest-1111013864 tempest-VolumesActionsTest-1111013864-project] 10.222.0.48 "GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf" status: 404 len: 111 microversion: 2.1 time: 0.154537 May 03 21:32:26.635218 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 231/498] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:26 2022] GET /compute/v2.1/servers/b5b63d26-d36d-440d-9107-9d20ffc97ecf => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 21:32:26.855595 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-5ef5c351-36da-479c-802e-3ebb710d86a1 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:26.858922 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-5ef5c351-36da-479c-802e-3ebb710d86a1 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:26.873938 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5ef5c351-36da-479c-802e-3ebb710d86a1 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:26.874391 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5ef5c351-36da-479c-802e-3ebb710d86a1 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:26.875250 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5ef5c351-36da-479c-802e-3ebb710d86a1 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:26.875692 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5ef5c351-36da-479c-802e-3ebb710d86a1 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:27.390724 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-5ef5c351-36da-479c-802e-3ebb710d86a1 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:27.410346 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-5ef5c351-36da-479c-802e-3ebb710d86a1 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:27.419837 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-5ef5c351-36da-479c-802e-3ebb710d86a1 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:27.421489 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-5ef5c351-36da-479c-802e-3ebb710d86a1 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1808 microversion: 2.20 time: 0.586031 May 03 21:32:27.422256 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 232/499] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:32:26 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1808 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:32:27.466461 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.wsgi [None req-17a6855c-7cfa-48db-84d6-3aeac1d9fe19 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] HTTP exception thrown: Invalid input received: Invalid volume: Volume 34c9d45b-c408-4504-a3cf-4787c0878669 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-9f52095a-606e-470a-ba1b-c06532f5679e) May 03 21:32:27.467257 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-17a6855c-7cfa-48db-84d6-3aeac1d9fe19 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Returning 400 to user: Invalid input received: Invalid volume: Volume 34c9d45b-c408-4504-a3cf-4787c0878669 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-9f52095a-606e-470a-ba1b-c06532f5679e) {{(pid=97832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:32:27.468106 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-17a6855c-7cfa-48db-84d6-3aeac1d9fe19 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "POST /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f/os-volume_attachments" status: 400 len: 279 microversion: 2.1 time: 0.914315 May 03 21:32:27.468726 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 268/500] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 3 21:32:26 2022] POST /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f/os-volume_attachments => generated 279 bytes in 917 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 03 21:32:27.483980 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-dce2409d-f7be-4c05-ae0a-bdc0648a8235 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:27.484549 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-dce2409d-f7be-4c05-ae0a-bdc0648a8235 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:27.493081 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-dce2409d-f7be-4c05-ae0a-bdc0648a8235 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:27.493629 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-dce2409d-f7be-4c05-ae0a-bdc0648a8235 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:27.494464 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-dce2409d-f7be-4c05-ae0a-bdc0648a8235 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:27.495229 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-dce2409d-f7be-4c05-ae0a-bdc0648a8235 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:27.501898 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-b5b3fc60-08ac-47cc-ac26-28de9e5e7b05 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:27.502651 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-b5b3fc60-08ac-47cc-ac26-28de9e5e7b05 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:27.510914 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b5b3fc60-08ac-47cc-ac26-28de9e5e7b05 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:27.511422 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b5b3fc60-08ac-47cc-ac26-28de9e5e7b05 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:27.512339 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b5b3fc60-08ac-47cc-ac26-28de9e5e7b05 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:27.512850 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b5b3fc60-08ac-47cc-ac26-28de9e5e7b05 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:27.568794 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-dce2409d-f7be-4c05-ae0a-bdc0648a8235 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Going to try to terminate instance {{(pid=97831) delete /opt/stack/nova/nova/compute/api.py:2559}} May 03 21:32:27.770143 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-b5b3fc60-08ac-47cc-ac26-28de9e5e7b05 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:27.784287 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-b5b3fc60-08ac-47cc-ac26-28de9e5e7b05 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6" status: 200 len: 1318 microversion: 2.1 time: 0.294466 May 03 21:32:27.788641 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 269/501] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:27 2022] GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6 => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:32:27.978073 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-dce2409d-f7be-4c05-ae0a-bdc0648a8235 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f" status: 204 len: 0 microversion: 2.1 time: 0.503488 May 03 21:32:27.982473 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 233/502] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 3 21:32:27 2022] DELETE /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 03 21:32:27.995792 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-350030dd-352a-4999-a5af-10d7e1c5d608 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:27.996854 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-350030dd-352a-4999-a5af-10d7e1c5d608 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:28.004872 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-350030dd-352a-4999-a5af-10d7e1c5d608 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:28.005396 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-350030dd-352a-4999-a5af-10d7e1c5d608 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:28.006421 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-350030dd-352a-4999-a5af-10d7e1c5d608 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:28.006862 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-350030dd-352a-4999-a5af-10d7e1c5d608 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:28.278370 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-350030dd-352a-4999-a5af-10d7e1c5d608 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:28.287570 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-350030dd-352a-4999-a5af-10d7e1c5d608 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f" status: 200 len: 1681 microversion: 2.1 time: 0.302779 May 03 21:32:28.288364 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 270/503] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:27 2022] GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f => generated 1681 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:32:28.450350 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-c56be7cf-ed6d-48f2-8fc9-d46b97d9a3f2 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:28.453232 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-c56be7cf-ed6d-48f2-8fc9-d46b97d9a3f2 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:28.459722 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c56be7cf-ed6d-48f2-8fc9-d46b97d9a3f2 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:28.460161 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c56be7cf-ed6d-48f2-8fc9-d46b97d9a3f2 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:28.460964 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c56be7cf-ed6d-48f2-8fc9-d46b97d9a3f2 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:28.461407 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c56be7cf-ed6d-48f2-8fc9-d46b97d9a3f2 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:28.808576 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-c95c4c35-e357-4767-8501-d378bf3858e4 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:28.809461 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-c95c4c35-e357-4767-8501-d378bf3858e4 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:28.819937 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c95c4c35-e357-4767-8501-d378bf3858e4 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:28.820566 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c95c4c35-e357-4767-8501-d378bf3858e4 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:28.822326 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c95c4c35-e357-4767-8501-d378bf3858e4 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:28.822886 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c95c4c35-e357-4767-8501-d378bf3858e4 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:28.876559 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-c56be7cf-ed6d-48f2-8fc9-d46b97d9a3f2 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:28.893214 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-c56be7cf-ed6d-48f2-8fc9-d46b97d9a3f2 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:28.900733 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-c56be7cf-ed6d-48f2-8fc9-d46b97d9a3f2 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:28.901963 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-c56be7cf-ed6d-48f2-8fc9-d46b97d9a3f2 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1808 microversion: 2.20 time: 0.464289 May 03 21:32:28.902542 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 234/504] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:32:28 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1808 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:32:29.213149 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-c95c4c35-e357-4767-8501-d378bf3858e4 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:29.230739 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-c95c4c35-e357-4767-8501-d378bf3858e4 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6" status: 200 len: 1318 microversion: 2.1 time: 0.431866 May 03 21:32:29.232088 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 271/505] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:28 2022] GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6 => generated 1318 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:29.319047 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-5f9d6427-9f39-4413-a4f5-f1351c21506d tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:29.319047 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-5f9d6427-9f39-4413-a4f5-f1351c21506d tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:29.327060 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5f9d6427-9f39-4413-a4f5-f1351c21506d tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:29.327760 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5f9d6427-9f39-4413-a4f5-f1351c21506d tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:29.328841 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5f9d6427-9f39-4413-a4f5-f1351c21506d tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:29.329495 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5f9d6427-9f39-4413-a4f5-f1351c21506d tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:29.791468 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-5f9d6427-9f39-4413-a4f5-f1351c21506d tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:29.811526 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-5f9d6427-9f39-4413-a4f5-f1351c21506d tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f" status: 200 len: 1681 microversion: 2.1 time: 0.500942 May 03 21:32:29.811526 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 235/506] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:29 2022] GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f => generated 1681 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:29.926372 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-0f91b3cb-8423-4906-b8cd-7f2c324e4ac4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:29.926975 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-0f91b3cb-8423-4906-b8cd-7f2c324e4ac4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:29.942309 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0f91b3cb-8423-4906-b8cd-7f2c324e4ac4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:29.942309 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0f91b3cb-8423-4906-b8cd-7f2c324e4ac4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:29.942309 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0f91b3cb-8423-4906-b8cd-7f2c324e4ac4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:29.942309 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0f91b3cb-8423-4906-b8cd-7f2c324e4ac4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:30.196919 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-0f91b3cb-8423-4906-b8cd-7f2c324e4ac4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:30.213203 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-0f91b3cb-8423-4906-b8cd-7f2c324e4ac4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:30.219636 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-0f91b3cb-8423-4906-b8cd-7f2c324e4ac4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:30.220931 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-0f91b3cb-8423-4906-b8cd-7f2c324e4ac4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1808 microversion: 2.20 time: 0.303804 May 03 21:32:30.221462 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 272/507] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:32:29 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1808 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:32:30.252959 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-fabacb93-0bff-4fc6-9cfb-cd660e946b16 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:30.253576 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-fabacb93-0bff-4fc6-9cfb-cd660e946b16 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:30.261383 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fabacb93-0bff-4fc6-9cfb-cd660e946b16 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:30.261780 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fabacb93-0bff-4fc6-9cfb-cd660e946b16 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:30.262568 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fabacb93-0bff-4fc6-9cfb-cd660e946b16 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:30.263011 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fabacb93-0bff-4fc6-9cfb-cd660e946b16 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:30.471825 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-fabacb93-0bff-4fc6-9cfb-cd660e946b16 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:30.481271 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-fabacb93-0bff-4fc6-9cfb-cd660e946b16 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6" status: 200 len: 1318 microversion: 2.1 time: 0.237555 May 03 21:32:30.481793 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 236/508] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:30 2022] GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:32:30.830440 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-29505220-f793-4430-8e82-d44acc26f5d2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:30.831203 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-29505220-f793-4430-8e82-d44acc26f5d2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:30.840403 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-29505220-f793-4430-8e82-d44acc26f5d2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:30.841021 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-29505220-f793-4430-8e82-d44acc26f5d2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:30.841648 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-29505220-f793-4430-8e82-d44acc26f5d2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:30.842075 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-29505220-f793-4430-8e82-d44acc26f5d2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:31.067106 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-29505220-f793-4430-8e82-d44acc26f5d2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:31.077493 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-29505220-f793-4430-8e82-d44acc26f5d2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f" status: 200 len: 1681 microversion: 2.1 time: 0.258482 May 03 21:32:31.090153 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 273/509] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:30 2022] GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f => generated 1681 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:31.246172 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-bcb490b2-ddfa-4e52-be5e-3e752578a55a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:31.246855 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-bcb490b2-ddfa-4e52-be5e-3e752578a55a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:31.254289 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-bcb490b2-ddfa-4e52-be5e-3e752578a55a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:31.254897 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-bcb490b2-ddfa-4e52-be5e-3e752578a55a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:31.255696 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-bcb490b2-ddfa-4e52-be5e-3e752578a55a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:31.256345 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-bcb490b2-ddfa-4e52-be5e-3e752578a55a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:31.543469 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-6c284f3f-ce4c-4f73-a276-07e26ced4ec9 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:31.543469 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-6c284f3f-ce4c-4f73-a276-07e26ced4ec9 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:31.543469 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6c284f3f-ce4c-4f73-a276-07e26ced4ec9 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:31.543469 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6c284f3f-ce4c-4f73-a276-07e26ced4ec9 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:31.544954 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6c284f3f-ce4c-4f73-a276-07e26ced4ec9 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:31.544954 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6c284f3f-ce4c-4f73-a276-07e26ced4ec9 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:31.604578 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-bcb490b2-ddfa-4e52-be5e-3e752578a55a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:31.640223 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-bcb490b2-ddfa-4e52-be5e-3e752578a55a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:31.652917 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-bcb490b2-ddfa-4e52-be5e-3e752578a55a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:31.654389 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-bcb490b2-ddfa-4e52-be5e-3e752578a55a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1808 microversion: 2.20 time: 0.418750 May 03 21:32:31.655468 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 237/510] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:32:31 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1808 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:32:31.793368 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-6c284f3f-ce4c-4f73-a276-07e26ced4ec9 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:31.804617 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-6c284f3f-ce4c-4f73-a276-07e26ced4ec9 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6" status: 200 len: 1318 microversion: 2.1 time: 0.307538 May 03 21:32:31.805555 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 274/511] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:31 2022] GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6 => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:32.108933 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-f536d51f-5f64-4394-aac3-1082832e45c2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:32.110327 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-f536d51f-5f64-4394-aac3-1082832e45c2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:32.131164 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f536d51f-5f64-4394-aac3-1082832e45c2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:32.132571 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f536d51f-5f64-4394-aac3-1082832e45c2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:32.134193 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f536d51f-5f64-4394-aac3-1082832e45c2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:32.135005 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f536d51f-5f64-4394-aac3-1082832e45c2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:32.556588 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-f536d51f-5f64-4394-aac3-1082832e45c2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:32.571949 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-f536d51f-5f64-4394-aac3-1082832e45c2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f" status: 200 len: 1681 microversion: 2.1 time: 0.480497 May 03 21:32:32.582222 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 238/512] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:32 2022] GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f => generated 1681 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:32.715482 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-f64ccc16-f7fd-4009-bbbc-699cee194315 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:32.717339 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-f64ccc16-f7fd-4009-bbbc-699cee194315 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:32.758331 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f64ccc16-f7fd-4009-bbbc-699cee194315 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:32.759124 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f64ccc16-f7fd-4009-bbbc-699cee194315 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:32.760103 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f64ccc16-f7fd-4009-bbbc-699cee194315 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:32.760987 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f64ccc16-f7fd-4009-bbbc-699cee194315 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:32.834325 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-fccc4f2b-28d5-45b3-a781-b243f73478bc tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:32.835561 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-fccc4f2b-28d5-45b3-a781-b243f73478bc tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:32.850296 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fccc4f2b-28d5-45b3-a781-b243f73478bc tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:32.854815 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fccc4f2b-28d5-45b3-a781-b243f73478bc tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:32.855919 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fccc4f2b-28d5-45b3-a781-b243f73478bc tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:32.857643 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fccc4f2b-28d5-45b3-a781-b243f73478bc tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:33.087385 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-f64ccc16-f7fd-4009-bbbc-699cee194315 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:33.104708 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-f64ccc16-f7fd-4009-bbbc-699cee194315 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:33.111606 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-f64ccc16-f7fd-4009-bbbc-699cee194315 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:33.113153 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-f64ccc16-f7fd-4009-bbbc-699cee194315 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1808 microversion: 2.20 time: 0.435796 May 03 21:32:33.125872 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 275/513] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:32:32 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1808 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:32:33.498925 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-fccc4f2b-28d5-45b3-a781-b243f73478bc tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:33.498925 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-fccc4f2b-28d5-45b3-a781-b243f73478bc tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6" status: 200 len: 1318 microversion: 2.1 time: 0.669228 May 03 21:32:33.498925 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 239/514] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:32 2022] GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6 => generated 1318 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:32:33.597664 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-72db365e-b321-4763-acd7-8e7772630ec1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:33.598527 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-72db365e-b321-4763-acd7-8e7772630ec1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:33.610653 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-72db365e-b321-4763-acd7-8e7772630ec1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:33.611159 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-72db365e-b321-4763-acd7-8e7772630ec1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:33.612250 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-72db365e-b321-4763-acd7-8e7772630ec1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:33.612919 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-72db365e-b321-4763-acd7-8e7772630ec1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:33.887583 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-72db365e-b321-4763-acd7-8e7772630ec1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:33.897093 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-72db365e-b321-4763-acd7-8e7772630ec1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f" status: 200 len: 1681 microversion: 2.1 time: 0.311107 May 03 21:32:33.900681 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 276/515] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:33 2022] GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f => generated 1681 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:34.150280 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-62d6a4ee-6418-41f1-b04b-8d3569194469 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:34.150960 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-62d6a4ee-6418-41f1-b04b-8d3569194469 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:34.158593 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-62d6a4ee-6418-41f1-b04b-8d3569194469 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:34.159295 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-62d6a4ee-6418-41f1-b04b-8d3569194469 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:34.160244 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-62d6a4ee-6418-41f1-b04b-8d3569194469 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:34.160869 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-62d6a4ee-6418-41f1-b04b-8d3569194469 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:34.557877 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-2c02e76c-a7e1-43ce-88df-51264cb9c1bb tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:34.561885 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-2c02e76c-a7e1-43ce-88df-51264cb9c1bb tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:34.594048 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2c02e76c-a7e1-43ce-88df-51264cb9c1bb tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:34.598055 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2c02e76c-a7e1-43ce-88df-51264cb9c1bb tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:34.598055 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2c02e76c-a7e1-43ce-88df-51264cb9c1bb tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:34.601001 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2c02e76c-a7e1-43ce-88df-51264cb9c1bb tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:34.810010 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-62d6a4ee-6418-41f1-b04b-8d3569194469 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:34.831714 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-62d6a4ee-6418-41f1-b04b-8d3569194469 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:34.843109 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-62d6a4ee-6418-41f1-b04b-8d3569194469 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:34.844730 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-62d6a4ee-6418-41f1-b04b-8d3569194469 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1808 microversion: 2.20 time: 0.716386 May 03 21:32:34.846324 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 240/516] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:32:34 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1808 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:32:34.934238 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-efba55d8-5ad1-43bd-89d1-bac8ca8184fc tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:34.935039 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-efba55d8-5ad1-43bd-89d1-bac8ca8184fc tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:34.964372 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-efba55d8-5ad1-43bd-89d1-bac8ca8184fc tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:34.965553 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-efba55d8-5ad1-43bd-89d1-bac8ca8184fc tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:34.966731 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-efba55d8-5ad1-43bd-89d1-bac8ca8184fc tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:34.967377 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-efba55d8-5ad1-43bd-89d1-bac8ca8184fc tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:35.298028 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-2c02e76c-a7e1-43ce-88df-51264cb9c1bb tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:35.328986 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-2c02e76c-a7e1-43ce-88df-51264cb9c1bb tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6" status: 200 len: 1318 microversion: 2.1 time: 0.819318 May 03 21:32:35.329982 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 277/517] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:34 2022] GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6 => generated 1318 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:32:35.361158 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-efba55d8-5ad1-43bd-89d1-bac8ca8184fc tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:35.387916 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-efba55d8-5ad1-43bd-89d1-bac8ca8184fc tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f" status: 200 len: 1613 microversion: 2.1 time: 0.473664 May 03 21:32:35.388491 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 241/518] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:34 2022] GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f => generated 1613 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:32:35.454030 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-1a8a2ca6-e6ec-42d7-92cc-f66bdea9dc1b req-ac3d6cd4-049e-43ff-a526-a93ab85be925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7faa75bc-a237-4850-b9c4-fcd56ac7b0b6", "name": "network-vif-plugged", "status": "completed", "tag": "3d939f88-ef7f-49d3-beb5-514a56fdf884"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:32:35.468856 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:32:35.468856 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:32:35.503207 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-1a8a2ca6-e6ec-42d7-92cc-f66bdea9dc1b req-ac3d6cd4-049e-43ff-a526-a93ab85be925 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:35.510610 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-1a8a2ca6-e6ec-42d7-92cc-f66bdea9dc1b req-ac3d6cd4-049e-43ff-a526-a93ab85be925 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:35.557474 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-1a8a2ca6-e6ec-42d7-92cc-f66bdea9dc1b req-ac3d6cd4-049e-43ff-a526-a93ab85be925 service nova] Creating event network-vif-plugged:3d939f88-ef7f-49d3-beb5-514a56fdf884 for instance 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6 on hv-cinder-84037 May 03 21:32:35.571278 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-1a8a2ca6-e6ec-42d7-92cc-f66bdea9dc1b req-ac3d6cd4-049e-43ff-a526-a93ab85be925 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136882 May 03 21:32:35.572048 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 278/519] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:32:35.735141 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-181a61d6-9e33-4b48-b8c7-e0328a04a7dd req-cc0191cc-4068-4f3b-82dd-d91b6a2721ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b1e6cc5-801c-4aa5-92fa-1f490590cb9f", "name": "network-vif-deleted", "tag": "da492c37-8214-4064-8e3b-45911d07e1d8"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:32:35.749917 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:32:35.749917 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:32:35.770475 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-181a61d6-9e33-4b48-b8c7-e0328a04a7dd req-cc0191cc-4068-4f3b-82dd-d91b6a2721ed service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:35.770983 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-181a61d6-9e33-4b48-b8c7-e0328a04a7dd req-cc0191cc-4068-4f3b-82dd-d91b6a2721ed service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:35.849235 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-181a61d6-9e33-4b48-b8c7-e0328a04a7dd req-cc0191cc-4068-4f3b-82dd-d91b6a2721ed service nova] Creating event network-vif-deleted:da492c37-8214-4064-8e3b-45911d07e1d8 for instance 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f on hv-cinder-84037 May 03 21:32:35.862222 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-181a61d6-9e33-4b48-b8c7-e0328a04a7dd req-cc0191cc-4068-4f3b-82dd-d91b6a2721ed service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136295 May 03 21:32:35.866078 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 242/520] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:32:35.875521 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-8d9a88f7-fae9-4ba4-98cc-6768fb75b586 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:35.877191 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-8d9a88f7-fae9-4ba4-98cc-6768fb75b586 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:35.916799 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8d9a88f7-fae9-4ba4-98cc-6768fb75b586 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:35.917737 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8d9a88f7-fae9-4ba4-98cc-6768fb75b586 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:35.918760 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8d9a88f7-fae9-4ba4-98cc-6768fb75b586 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:35.919496 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8d9a88f7-fae9-4ba4-98cc-6768fb75b586 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:36.028851 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-7fe8fa59-4031-4ed2-a88a-c1e3a6f88959 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:32:36.031782 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-7fe8fa59-4031-4ed2-a88a-c1e3a6f88959 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:36.044196 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7fe8fa59-4031-4ed2-a88a-c1e3a6f88959 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:36.045129 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7fe8fa59-4031-4ed2-a88a-c1e3a6f88959 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:36.046694 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7fe8fa59-4031-4ed2-a88a-c1e3a6f88959 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:36.047416 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7fe8fa59-4031-4ed2-a88a-c1e3a6f88959 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:36.151169 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.objects.instance [None req-7fe8fa59-4031-4ed2-a88a-c1e3a6f88959 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lazy-loading 'flavor' on Instance uuid cb2b9b5d-640a-401a-ac60-566b6d8dbc52 {{(pid=97831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 03 21:32:36.310417 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-8d9a88f7-fae9-4ba4-98cc-6768fb75b586 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:36.364637 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-8d9a88f7-fae9-4ba4-98cc-6768fb75b586 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:36.383338 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-8d9a88f7-fae9-4ba4-98cc-6768fb75b586 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:36.384975 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-8d9a88f7-fae9-4ba4-98cc-6768fb75b586 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1808 microversion: 2.20 time: 0.523077 May 03 21:32:36.391721 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 279/521] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:32:35 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1808 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:32:36.410319 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-500ff443-e121-410a-a9b9-40f82050b290 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:36.416993 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-500ff443-e121-410a-a9b9-40f82050b290 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:36.429829 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-500ff443-e121-410a-a9b9-40f82050b290 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:36.430556 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-500ff443-e121-410a-a9b9-40f82050b290 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:36.431505 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-500ff443-e121-410a-a9b9-40f82050b290 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:36.432138 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-500ff443-e121-410a-a9b9-40f82050b290 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:36.814385 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-500ff443-e121-410a-a9b9-40f82050b290 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:36.828273 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-500ff443-e121-410a-a9b9-40f82050b290 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6" status: 200 len: 1318 microversion: 2.1 time: 0.435025 May 03 21:32:36.835506 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 280/522] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:36 2022] GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6 => generated 1318 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:36.847623 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-c5447287-abd7-49b3-891e-18efbe0b8e40 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:36.850547 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-c5447287-abd7-49b3-891e-18efbe0b8e40 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:36.861096 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c5447287-abd7-49b3-891e-18efbe0b8e40 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:36.862137 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c5447287-abd7-49b3-891e-18efbe0b8e40 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:36.863205 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c5447287-abd7-49b3-891e-18efbe0b8e40 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:36.864028 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c5447287-abd7-49b3-891e-18efbe0b8e40 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:36.986750 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c5447287-abd7-49b3-891e-18efbe0b8e40 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:36.987552 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c5447287-abd7-49b3-891e-18efbe0b8e40 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:36.988252 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.objects.instance [None req-c5447287-abd7-49b3-891e-18efbe0b8e40 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lazy-loading 'fault' on Instance uuid 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f {{(pid=97832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 03 21:32:37.079039 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-c5447287-abd7-49b3-891e-18efbe0b8e40 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:37.092462 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-c5447287-abd7-49b3-891e-18efbe0b8e40 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f" status: 200 len: 1332 microversion: 2.1 time: 0.255073 May 03 21:32:37.096932 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 281/523] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:36 2022] GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f => generated 1332 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:37.170195 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-7fe8fa59-4031-4ed2-a88a-c1e3a6f88959 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "POST /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52/action" status: 200 len: 32 microversion: 2.1 time: 1.157127 May 03 21:32:37.175488 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 243/524] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 3 21:32:36 2022] POST /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52/action => generated 32 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 03 21:32:37.209019 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-4768acc2-b5a5-478f-bc6b-23449437cdb8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:37.210396 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-4768acc2-b5a5-478f-bc6b-23449437cdb8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:37.231626 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4768acc2-b5a5-478f-bc6b-23449437cdb8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:37.232210 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4768acc2-b5a5-478f-bc6b-23449437cdb8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:37.233225 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4768acc2-b5a5-478f-bc6b-23449437cdb8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:37.233732 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4768acc2-b5a5-478f-bc6b-23449437cdb8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:37.434940 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-c338f486-36b9-4be1-ba85-665cc21db3ef tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:37.439406 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-c338f486-36b9-4be1-ba85-665cc21db3ef tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:37.479478 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c338f486-36b9-4be1-ba85-665cc21db3ef tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:37.481102 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c338f486-36b9-4be1-ba85-665cc21db3ef tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:37.482065 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c338f486-36b9-4be1-ba85-665cc21db3ef tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:37.483099 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c338f486-36b9-4be1-ba85-665cc21db3ef tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:37.731980 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-4768acc2-b5a5-478f-bc6b-23449437cdb8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:37.747488 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-4768acc2-b5a5-478f-bc6b-23449437cdb8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1736 microversion: 2.1 time: 0.570531 May 03 21:32:37.774388 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 282/525] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:37 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1736 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:37.881948 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-ca3f1b56-ffd0-49b5-9055-297bb358cf3a tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:37.884964 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-ca3f1b56-ffd0-49b5-9055-297bb358cf3a tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:37.923162 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ca3f1b56-ffd0-49b5-9055-297bb358cf3a tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:37.928398 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ca3f1b56-ffd0-49b5-9055-297bb358cf3a tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:37.932784 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ca3f1b56-ffd0-49b5-9055-297bb358cf3a tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:37.933399 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ca3f1b56-ffd0-49b5-9055-297bb358cf3a tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:38.392907 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-c338f486-36b9-4be1-ba85-665cc21db3ef tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:38.423208 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-ca3f1b56-ffd0-49b5-9055-297bb358cf3a tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:38.427006 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-c338f486-36b9-4be1-ba85-665cc21db3ef tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:38.435270 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-ca3f1b56-ffd0-49b5-9055-297bb358cf3a tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6" status: 200 len: 1318 microversion: 2.1 time: 0.587567 May 03 21:32:38.436477 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 283/526] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:37 2022] GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6 => generated 1318 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:38.448471 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-ca80b16d-8cf6-48ee-bb0e-4a939831f1dc tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:38.449402 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-ca80b16d-8cf6-48ee-bb0e-4a939831f1dc tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:38.456642 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-c338f486-36b9-4be1-ba85-665cc21db3ef tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:38.457824 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ca80b16d-8cf6-48ee-bb0e-4a939831f1dc tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:38.458594 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-c338f486-36b9-4be1-ba85-665cc21db3ef tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1808 microversion: 2.20 time: 1.050205 May 03 21:32:38.459258 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 244/527] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:32:37 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1808 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:32:38.459526 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ca80b16d-8cf6-48ee-bb0e-4a939831f1dc tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:38.461211 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ca80b16d-8cf6-48ee-bb0e-4a939831f1dc tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:38.461837 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ca80b16d-8cf6-48ee-bb0e-4a939831f1dc tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:38.533832 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.wsgi [None req-ca80b16d-8cf6-48ee-bb0e-4a939831f1dc tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] HTTP exception thrown: Instance 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f could not be found. May 03 21:32:38.535678 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-ca80b16d-8cf6-48ee-bb0e-4a939831f1dc tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Returning 404 to user: Instance 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f could not be found. {{(pid=97832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:32:38.535678 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-ca80b16d-8cf6-48ee-bb0e-4a939831f1dc tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f" status: 404 len: 111 microversion: 2.1 time: 0.097669 May 03 21:32:38.536223 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 284/528] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:38 2022] GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 21:32:38.553443 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-7d4befb4-ca46-40b6-bf8a-67f11c541086 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '.version_select at 0x7fc84ce33b80>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:38.694246 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-7d4befb4-ca46-40b6-bf8a-67f11c541086 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2139605624" status: 202 len: 0 microversion: 2.1 time: 0.153183 May 03 21:32:38.695361 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 245/529] 10.222.0.48 () {58 vars in 1220 bytes} [Tue May 3 21:32:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2139605624 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 21:32:38.718409 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-88584f37-0520-48c2-90d5-b7ecab627b33 req-64fb44cb-7c0d-4c77-91f3-5fcd431409ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f6a8a2-4366-486d-a002-05587e0f46b5", "name": "network-vif-plugged", "status": "completed", "tag": "be428a12-3d87-4da1-a665-e7b79df6af66"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:32:38.730545 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:32:38.730545 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:32:38.748521 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-88584f37-0520-48c2-90d5-b7ecab627b33 req-64fb44cb-7c0d-4c77-91f3-5fcd431409ef service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:38.748521 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-88584f37-0520-48c2-90d5-b7ecab627b33 req-64fb44cb-7c0d-4c77-91f3-5fcd431409ef service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:38.781784 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-ee818fcb-59ed-4a33-b15b-ef873b91b919 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:38.782566 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-ee818fcb-59ed-4a33-b15b-ef873b91b919 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:38.796397 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-88584f37-0520-48c2-90d5-b7ecab627b33 req-64fb44cb-7c0d-4c77-91f3-5fcd431409ef service nova] Creating event network-vif-plugged:be428a12-3d87-4da1-a665-e7b79df6af66 for instance 77f6a8a2-4366-486d-a002-05587e0f46b5 on hv-cinder-84037 May 03 21:32:38.807478 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ee818fcb-59ed-4a33-b15b-ef873b91b919 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:38.809761 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-88584f37-0520-48c2-90d5-b7ecab627b33 req-64fb44cb-7c0d-4c77-91f3-5fcd431409ef service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127811 May 03 21:32:38.810313 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ee818fcb-59ed-4a33-b15b-ef873b91b919 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:38.811884 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ee818fcb-59ed-4a33-b15b-ef873b91b919 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:38.812299 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 285/530] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:32:38.812841 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ee818fcb-59ed-4a33-b15b-ef873b91b919 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:39.179859 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-fb24af57-d1f4-4097-81ae-817ed2b284ef tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:39.180902 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-fb24af57-d1f4-4097-81ae-817ed2b284ef tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:39.204454 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fb24af57-d1f4-4097-81ae-817ed2b284ef tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:39.204924 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fb24af57-d1f4-4097-81ae-817ed2b284ef tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:39.205779 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fb24af57-d1f4-4097-81ae-817ed2b284ef tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:39.206294 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fb24af57-d1f4-4097-81ae-817ed2b284ef tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:39.211782 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-ee818fcb-59ed-4a33-b15b-ef873b91b919 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:39.227900 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-ee818fcb-59ed-4a33-b15b-ef873b91b919 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1736 microversion: 2.1 time: 0.465856 May 03 21:32:39.228915 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 246/531] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:38 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1736 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:32:39.470252 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-58f06a87-a58d-44ff-9276-a1474554fc44 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:39.472899 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-58f06a87-a58d-44ff-9276-a1474554fc44 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:39.485304 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-58f06a87-a58d-44ff-9276-a1474554fc44 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:39.486167 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-58f06a87-a58d-44ff-9276-a1474554fc44 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:39.489927 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-58f06a87-a58d-44ff-9276-a1474554fc44 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:39.496417 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-58f06a87-a58d-44ff-9276-a1474554fc44 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:40.087433 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-fb24af57-d1f4-4097-81ae-817ed2b284ef tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "DELETE /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a/os-volume_attachments/5a3a50dc-a809-4136-9d23-292a72887d4f" status: 202 len: 0 microversion: 2.1 time: 0.937235 May 03 21:32:40.092831 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 286/532] 10.222.0.48 () {58 vars in 1415 bytes} [Tue May 3 21:32:39 2022] DELETE /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a/os-volume_attachments/5a3a50dc-a809-4136-9d23-292a72887d4f => generated 0 bytes in 944 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 03 21:32:40.139935 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-a8feb80b-887f-4829-a1b8-a2b5bdf49d43 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:40.140757 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-a8feb80b-887f-4829-a1b8-a2b5bdf49d43 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:40.160010 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a8feb80b-887f-4829-a1b8-a2b5bdf49d43 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:40.163355 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a8feb80b-887f-4829-a1b8-a2b5bdf49d43 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:40.163355 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a8feb80b-887f-4829-a1b8-a2b5bdf49d43 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:40.166219 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a8feb80b-887f-4829-a1b8-a2b5bdf49d43 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:40.171245 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-58f06a87-a58d-44ff-9276-a1474554fc44 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:40.206803 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-58f06a87-a58d-44ff-9276-a1474554fc44 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6" status: 200 len: 1507 microversion: 2.1 time: 0.750397 May 03 21:32:40.209753 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 247/533] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:39 2022] GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6 => generated 1507 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:32:40.270240 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-cd337fab-d7ea-49cd-bbc1-c8b090fc9596 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b45cc8cb-d92f-4ac8-9bce-4a8516c6ba72", "device": "/dev/sdb"}} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:32:40.287223 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-cd337fab-d7ea-49cd-bbc1-c8b090fc9596 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:40.323641 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-cd337fab-d7ea-49cd-bbc1-c8b090fc9596 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:40.333863 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-cd337fab-d7ea-49cd-bbc1-c8b090fc9596 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:40.334882 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-cd337fab-d7ea-49cd-bbc1-c8b090fc9596 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:40.335673 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-cd337fab-d7ea-49cd-bbc1-c8b090fc9596 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:40.959179 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-a8feb80b-887f-4829-a1b8-a2b5bdf49d43 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:40.975158 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-a8feb80b-887f-4829-a1b8-a2b5bdf49d43 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:40.996328 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-a8feb80b-887f-4829-a1b8-a2b5bdf49d43 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:40.996328 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-a8feb80b-887f-4829-a1b8-a2b5bdf49d43 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1808 microversion: 2.20 time: 0.889109 May 03 21:32:40.996328 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 287/534] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:32:40 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1808 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:32:40.996328 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-42dbf11a-0ce4-42a7-9f57-07a686b77856 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:40.996786 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-42dbf11a-0ce4-42a7-9f57-07a686b77856 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:41.007940 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-42dbf11a-0ce4-42a7-9f57-07a686b77856 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:41.008499 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-42dbf11a-0ce4-42a7-9f57-07a686b77856 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:41.009352 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-42dbf11a-0ce4-42a7-9f57-07a686b77856 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:41.011016 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-42dbf11a-0ce4-42a7-9f57-07a686b77856 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:41.313668 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-42dbf11a-0ce4-42a7-9f57-07a686b77856 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:41.326666 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-42dbf11a-0ce4-42a7-9f57-07a686b77856 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1736 microversion: 2.1 time: 0.341846 May 03 21:32:41.330727 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 288/535] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:40 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1736 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:42.063227 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-22c56e09-776c-4041-8ffa-2fd934b6d9e2 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:42.063227 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-22c56e09-776c-4041-8ffa-2fd934b6d9e2 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:42.096008 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-22c56e09-776c-4041-8ffa-2fd934b6d9e2 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:42.096008 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-22c56e09-776c-4041-8ffa-2fd934b6d9e2 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:42.097560 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-22c56e09-776c-4041-8ffa-2fd934b6d9e2 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:42.097560 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-22c56e09-776c-4041-8ffa-2fd934b6d9e2 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:42.537491 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-22c56e09-776c-4041-8ffa-2fd934b6d9e2 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:42.554474 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-22c56e09-776c-4041-8ffa-2fd934b6d9e2 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:42.564535 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-22c56e09-776c-4041-8ffa-2fd934b6d9e2 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:42.566020 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-22c56e09-776c-4041-8ffa-2fd934b6d9e2 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1808 microversion: 2.20 time: 0.565508 May 03 21:32:42.567023 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 289/536] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:32:41 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1808 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 21:32:42.579114 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-cd337fab-d7ea-49cd-bbc1-c8b090fc9596 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "POST /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.356977 May 03 21:32:42.583060 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-11eb1e77-2bd8-4632-9f5c-9d97f1cdb6b8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:42.584122 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-11eb1e77-2bd8-4632-9f5c-9d97f1cdb6b8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:42.584780 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 248/537] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 3 21:32:40 2022] POST /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6/os-volume_attachments => generated 194 bytes in 2364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:32:42.619264 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-11eb1e77-2bd8-4632-9f5c-9d97f1cdb6b8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:42.620260 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-11eb1e77-2bd8-4632-9f5c-9d97f1cdb6b8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:42.621494 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-11eb1e77-2bd8-4632-9f5c-9d97f1cdb6b8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:42.625261 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-11eb1e77-2bd8-4632-9f5c-9d97f1cdb6b8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:42.714624 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-77a33d2d-6705-4710-8ae4-ea6608c727da tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:32:42.736901 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-77a33d2d-6705-4710-8ae4-ea6608c727da tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:42.739665 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-77a33d2d-6705-4710-8ae4-ea6608c727da tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:42.924929 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-77a33d2d-6705-4710-8ae4-ea6608c727da tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Going to try to stop instance {{(pid=97831) force_stop /opt/stack/nova/nova/compute/api.py:2599}} May 03 21:32:43.219994 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-77a33d2d-6705-4710-8ae4-ea6608c727da tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "POST /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a/action" status: 202 len: 0 microversion: 2.1 time: 0.516277 May 03 21:32:43.223832 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 249/538] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 3 21:32:42 2022] POST /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 21:32:43.231401 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-11eb1e77-2bd8-4632-9f5c-9d97f1cdb6b8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:43.246012 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-11eb1e77-2bd8-4632-9f5c-9d97f1cdb6b8 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1736 microversion: 2.1 time: 0.676654 May 03 21:32:43.246669 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 290/539] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:42 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1736 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:43.251355 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-a3ae43d9-0c12-4c83-808f-f7e016e8dad2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:43.251956 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-a3ae43d9-0c12-4c83-808f-f7e016e8dad2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:43.275496 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a3ae43d9-0c12-4c83-808f-f7e016e8dad2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:43.275949 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a3ae43d9-0c12-4c83-808f-f7e016e8dad2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:43.276781 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a3ae43d9-0c12-4c83-808f-f7e016e8dad2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:43.277394 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a3ae43d9-0c12-4c83-808f-f7e016e8dad2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:43.280574 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-a45ff958-08b6-42aa-bb09-9bef06967c00 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:43.281866 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-a45ff958-08b6-42aa-bb09-9bef06967c00 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:43.294020 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a45ff958-08b6-42aa-bb09-9bef06967c00 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:43.294683 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a45ff958-08b6-42aa-bb09-9bef06967c00 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:43.295576 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a45ff958-08b6-42aa-bb09-9bef06967c00 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:43.296133 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a45ff958-08b6-42aa-bb09-9bef06967c00 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:43.746893 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-a45ff958-08b6-42aa-bb09-9bef06967c00 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:43.768313 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-a45ff958-08b6-42aa-bb09-9bef06967c00 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1676 microversion: 2.1 time: 0.510058 May 03 21:32:43.769621 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 291/540] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:43 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1676 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:43.797501 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-0c2e45e5-d1fb-40a8-b2ed-df937ce0f8fc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:43.798558 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-0c2e45e5-d1fb-40a8-b2ed-df937ce0f8fc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:43.812212 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0c2e45e5-d1fb-40a8-b2ed-df937ce0f8fc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:43.812981 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0c2e45e5-d1fb-40a8-b2ed-df937ce0f8fc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:43.814613 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0c2e45e5-d1fb-40a8-b2ed-df937ce0f8fc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:43.815341 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0c2e45e5-d1fb-40a8-b2ed-df937ce0f8fc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:43.997939 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-a3ae43d9-0c12-4c83-808f-f7e016e8dad2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "DELETE /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14/os-volume_attachments/34c9d45b-c408-4504-a3cf-4787c0878669" status: 202 len: 0 microversion: 2.1 time: 0.775418 May 03 21:32:44.000157 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 250/541] 10.222.0.48 () {58 vars in 1415 bytes} [Tue May 3 21:32:43 2022] DELETE /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14/os-volume_attachments/34c9d45b-c408-4504-a3cf-4787c0878669 => generated 0 bytes in 779 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 21:32:44.049790 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-cd1c12ff-3b5b-4aa6-ab76-cdb3891d2647 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:44.050371 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-cd1c12ff-3b5b-4aa6-ab76-cdb3891d2647 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:44.095051 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-cd1c12ff-3b5b-4aa6-ab76-cdb3891d2647 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:44.095738 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-cd1c12ff-3b5b-4aa6-ab76-cdb3891d2647 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:44.097253 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-cd1c12ff-3b5b-4aa6-ab76-cdb3891d2647 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:44.099434 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-cd1c12ff-3b5b-4aa6-ab76-cdb3891d2647 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:44.269185 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-cd1c12ff-3b5b-4aa6-ab76-cdb3891d2647 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.260204 May 03 21:32:44.274256 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 251/542] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 3 21:32:44 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14/os-volume_attachments => generated 197 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:32:44.281295 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-0c2e45e5-d1fb-40a8-b2ed-df937ce0f8fc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:44.286836 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-c83596cb-7a47-4602-8c6c-d040e142cdfd tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:44.287461 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-c83596cb-7a47-4602-8c6c-d040e142cdfd tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:44.298060 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c83596cb-7a47-4602-8c6c-d040e142cdfd tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:44.298522 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c83596cb-7a47-4602-8c6c-d040e142cdfd tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:44.299750 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c83596cb-7a47-4602-8c6c-d040e142cdfd tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:44.300187 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c83596cb-7a47-4602-8c6c-d040e142cdfd tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:44.312779 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-0c2e45e5-d1fb-40a8-b2ed-df937ce0f8fc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:44.356068 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-0c2e45e5-d1fb-40a8-b2ed-df937ce0f8fc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:44.357262 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-0c2e45e5-d1fb-40a8-b2ed-df937ce0f8fc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1808 microversion: 2.20 time: 0.585560 May 03 21:32:44.363752 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 292/543] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:32:43 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1808 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:32:44.605029 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-c83596cb-7a47-4602-8c6c-d040e142cdfd tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:44.622514 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-c83596cb-7a47-4602-8c6c-d040e142cdfd tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1736 microversion: 2.1 time: 0.347029 May 03 21:32:44.623815 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 252/544] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:44 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1736 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:44.797398 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-5105400d-c022-4a09-a8ea-c2bc9826f855 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:44.798030 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-5105400d-c022-4a09-a8ea-c2bc9826f855 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:44.812265 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5105400d-c022-4a09-a8ea-c2bc9826f855 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:44.857168 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5105400d-c022-4a09-a8ea-c2bc9826f855 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:44.857168 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5105400d-c022-4a09-a8ea-c2bc9826f855 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:44.857168 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5105400d-c022-4a09-a8ea-c2bc9826f855 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:45.097585 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-5105400d-c022-4a09-a8ea-c2bc9826f855 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:45.110881 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-5105400d-c022-4a09-a8ea-c2bc9826f855 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1676 microversion: 2.1 time: 0.322776 May 03 21:32:45.112064 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 293/545] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:44 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1676 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:45.298787 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-34f1186b-4bd5-46e3-aec5-89ae6bd55739 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:45.306924 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-34f1186b-4bd5-46e3-aec5-89ae6bd55739 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:45.339927 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-34f1186b-4bd5-46e3-aec5-89ae6bd55739 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:45.340714 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-34f1186b-4bd5-46e3-aec5-89ae6bd55739 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:45.341704 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-34f1186b-4bd5-46e3-aec5-89ae6bd55739 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:45.342303 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-34f1186b-4bd5-46e3-aec5-89ae6bd55739 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:45.397104 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-9c71ec3d-1519-4a1e-9de9-11bee03e809b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:45.398323 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-9c71ec3d-1519-4a1e-9de9-11bee03e809b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:45.424623 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9c71ec3d-1519-4a1e-9de9-11bee03e809b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:45.425085 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9c71ec3d-1519-4a1e-9de9-11bee03e809b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:45.425903 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9c71ec3d-1519-4a1e-9de9-11bee03e809b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:45.426326 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9c71ec3d-1519-4a1e-9de9-11bee03e809b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:45.466288 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-34f1186b-4bd5-46e3-aec5-89ae6bd55739 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.187854 May 03 21:32:45.471457 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 253/546] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 3 21:32:45 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:32:45.668491 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-98eb3303-d3d7-4fce-ad5a-4079954c0b9a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:45.669140 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-98eb3303-d3d7-4fce-ad5a-4079954c0b9a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:45.689902 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-98eb3303-d3d7-4fce-ad5a-4079954c0b9a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:45.690569 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-98eb3303-d3d7-4fce-ad5a-4079954c0b9a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:45.691401 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-98eb3303-d3d7-4fce-ad5a-4079954c0b9a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:45.691780 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-98eb3303-d3d7-4fce-ad5a-4079954c0b9a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:45.714387 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-9c71ec3d-1519-4a1e-9de9-11bee03e809b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:45.741194 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-9c71ec3d-1519-4a1e-9de9-11bee03e809b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:45.759457 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-9c71ec3d-1519-4a1e-9de9-11bee03e809b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:45.761379 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-9c71ec3d-1519-4a1e-9de9-11bee03e809b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1795 microversion: 2.20 time: 0.381303 May 03 21:32:45.763158 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 294/547] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:32:45 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1795 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:32:46.117900 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-98eb3303-d3d7-4fce-ad5a-4079954c0b9a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:46.147811 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-34cd865a-b20b-4458-8fd9-302e8d62e1cb tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:46.162628 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-34cd865a-b20b-4458-8fd9-302e8d62e1cb tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:46.188110 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-98eb3303-d3d7-4fce-ad5a-4079954c0b9a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1736 microversion: 2.1 time: 0.540110 May 03 21:32:46.194060 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 254/548] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:45 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1736 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:46.227991 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-34cd865a-b20b-4458-8fd9-302e8d62e1cb tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:46.229827 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-34cd865a-b20b-4458-8fd9-302e8d62e1cb tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:46.234031 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-34cd865a-b20b-4458-8fd9-302e8d62e1cb tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:46.242362 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-34cd865a-b20b-4458-8fd9-302e8d62e1cb tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:46.499253 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-17e4f178-fa86-4c14-a88f-ec4257ce17cf tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:46.501012 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-17e4f178-fa86-4c14-a88f-ec4257ce17cf tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:46.520766 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-17e4f178-fa86-4c14-a88f-ec4257ce17cf tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:46.524949 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-17e4f178-fa86-4c14-a88f-ec4257ce17cf tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:46.532995 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-17e4f178-fa86-4c14-a88f-ec4257ce17cf tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:46.532995 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-17e4f178-fa86-4c14-a88f-ec4257ce17cf tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:46.661611 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-17e4f178-fa86-4c14-a88f-ec4257ce17cf tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.182590 May 03 21:32:46.661611 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 255/549] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 3 21:32:46 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:32:46.751603 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-34cd865a-b20b-4458-8fd9-302e8d62e1cb tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:46.764828 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-34cd865a-b20b-4458-8fd9-302e8d62e1cb tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1676 microversion: 2.1 time: 0.638339 May 03 21:32:46.770679 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 295/550] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:46 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1676 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:47.226569 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-00b723b3-49a7-41ec-89a2-cd3a57213a19 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:47.235268 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-00b723b3-49a7-41ec-89a2-cd3a57213a19 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:47.248550 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-00b723b3-49a7-41ec-89a2-cd3a57213a19 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:47.249296 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-00b723b3-49a7-41ec-89a2-cd3a57213a19 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:47.250376 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-00b723b3-49a7-41ec-89a2-cd3a57213a19 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:47.250892 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-00b723b3-49a7-41ec-89a2-cd3a57213a19 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:47.555821 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-00b723b3-49a7-41ec-89a2-cd3a57213a19 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:47.565523 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-00b723b3-49a7-41ec-89a2-cd3a57213a19 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1736 microversion: 2.1 time: 0.350080 May 03 21:32:47.566111 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 256/551] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:47 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1736 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:47.688506 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-09ad5aa2-9b67-4128-b287-c414c44f4e19 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:47.690956 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-09ad5aa2-9b67-4128-b287-c414c44f4e19 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:47.704148 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-09ad5aa2-9b67-4128-b287-c414c44f4e19 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:47.704903 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-09ad5aa2-9b67-4128-b287-c414c44f4e19 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:47.705698 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-09ad5aa2-9b67-4128-b287-c414c44f4e19 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:47.706287 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-09ad5aa2-9b67-4128-b287-c414c44f4e19 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:47.789759 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-09ad5aa2-9b67-4128-b287-c414c44f4e19 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122171 May 03 21:32:47.790795 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 296/552] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 3 21:32:47 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:32:47.795561 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-5c5e2a75-8a47-4c02-a2c5-88c1c58afae7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:47.796564 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-5c5e2a75-8a47-4c02-a2c5-88c1c58afae7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:47.807733 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5c5e2a75-8a47-4c02-a2c5-88c1c58afae7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:47.808524 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5c5e2a75-8a47-4c02-a2c5-88c1c58afae7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:47.809490 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5c5e2a75-8a47-4c02-a2c5-88c1c58afae7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:47.809922 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5c5e2a75-8a47-4c02-a2c5-88c1c58afae7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:48.119974 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-5c5e2a75-8a47-4c02-a2c5-88c1c58afae7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:48.134218 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-5c5e2a75-8a47-4c02-a2c5-88c1c58afae7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1676 microversion: 2.1 time: 0.354877 May 03 21:32:48.135115 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 257/553] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:47 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1676 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:32:48.597023 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-2aab7dd6-f947-45f3-95ea-bcf72af6867f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:48.598006 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-2aab7dd6-f947-45f3-95ea-bcf72af6867f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:48.606994 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2aab7dd6-f947-45f3-95ea-bcf72af6867f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:48.607434 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2aab7dd6-f947-45f3-95ea-bcf72af6867f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:48.608226 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2aab7dd6-f947-45f3-95ea-bcf72af6867f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:48.608690 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2aab7dd6-f947-45f3-95ea-bcf72af6867f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:48.809701 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-9eaca088-7bb6-44a6-bef1-3c27ad812914 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:48.811386 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-9eaca088-7bb6-44a6-bef1-3c27ad812914 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:48.826516 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9eaca088-7bb6-44a6-bef1-3c27ad812914 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:48.827430 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9eaca088-7bb6-44a6-bef1-3c27ad812914 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:48.828681 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9eaca088-7bb6-44a6-bef1-3c27ad812914 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:48.829420 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9eaca088-7bb6-44a6-bef1-3c27ad812914 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:48.892417 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-2aab7dd6-f947-45f3-95ea-bcf72af6867f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:48.901658 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-2aab7dd6-f947-45f3-95ea-bcf72af6867f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1736 microversion: 2.1 time: 0.314367 May 03 21:32:48.902841 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 297/554] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:48 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1736 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:48.928641 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-9eaca088-7bb6-44a6-bef1-3c27ad812914 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130717 May 03 21:32:48.929592 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 258/555] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 3 21:32:48 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:32:49.157737 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-4c69d5a2-96f8-4625-ad8c-7d84f067fe93 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:49.158347 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-4c69d5a2-96f8-4625-ad8c-7d84f067fe93 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:49.169523 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4c69d5a2-96f8-4625-ad8c-7d84f067fe93 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:49.170192 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4c69d5a2-96f8-4625-ad8c-7d84f067fe93 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:49.171250 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4c69d5a2-96f8-4625-ad8c-7d84f067fe93 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:49.177019 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4c69d5a2-96f8-4625-ad8c-7d84f067fe93 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:49.440579 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-4c69d5a2-96f8-4625-ad8c-7d84f067fe93 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:49.450420 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-4c69d5a2-96f8-4625-ad8c-7d84f067fe93 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1676 microversion: 2.1 time: 0.302179 May 03 21:32:49.460766 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 298/556] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:49 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1676 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:49.938121 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-f96dcb2f-e82c-4dde-924f-8253a7b9bc78 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:49.939508 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-f96dcb2f-e82c-4dde-924f-8253a7b9bc78 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:49.950328 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f96dcb2f-e82c-4dde-924f-8253a7b9bc78 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:49.951179 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f96dcb2f-e82c-4dde-924f-8253a7b9bc78 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:49.953113 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f96dcb2f-e82c-4dde-924f-8253a7b9bc78 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:49.953807 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f96dcb2f-e82c-4dde-924f-8253a7b9bc78 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:49.960652 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-1b82c0f1-127c-4fb3-bcf8-7bca6b8208e9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:49.962626 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-1b82c0f1-127c-4fb3-bcf8-7bca6b8208e9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:49.975860 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-1b82c0f1-127c-4fb3-bcf8-7bca6b8208e9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:49.976319 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-1b82c0f1-127c-4fb3-bcf8-7bca6b8208e9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:49.980163 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-1b82c0f1-127c-4fb3-bcf8-7bca6b8208e9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:49.980163 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-1b82c0f1-127c-4fb3-bcf8-7bca6b8208e9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:50.085195 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-1b82c0f1-127c-4fb3-bcf8-7bca6b8208e9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147688 May 03 21:32:50.086231 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 299/557] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 3 21:32:49 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:32:50.250176 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-f96dcb2f-e82c-4dde-924f-8253a7b9bc78 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:50.262199 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-f96dcb2f-e82c-4dde-924f-8253a7b9bc78 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1736 microversion: 2.1 time: 0.340564 May 03 21:32:50.262763 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 259/558] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:49 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1736 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:50.479196 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-11254417-fdc2-43e8-90b9-164983d52011 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:50.479878 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-11254417-fdc2-43e8-90b9-164983d52011 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:50.487460 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-11254417-fdc2-43e8-90b9-164983d52011 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:50.487914 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-11254417-fdc2-43e8-90b9-164983d52011 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:50.489304 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-11254417-fdc2-43e8-90b9-164983d52011 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:50.489742 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-11254417-fdc2-43e8-90b9-164983d52011 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:50.762283 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-11254417-fdc2-43e8-90b9-164983d52011 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:50.783833 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-11254417-fdc2-43e8-90b9-164983d52011 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1676 microversion: 2.1 time: 0.319997 May 03 21:32:50.793872 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 300/559] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:50 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1676 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:51.116332 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-38a24b61-849e-4806-90d2-aab755a47043 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:51.120906 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-38a24b61-849e-4806-90d2-aab755a47043 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:51.155461 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-38a24b61-849e-4806-90d2-aab755a47043 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:51.156083 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-38a24b61-849e-4806-90d2-aab755a47043 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:51.163555 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-38a24b61-849e-4806-90d2-aab755a47043 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:51.164300 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-38a24b61-849e-4806-90d2-aab755a47043 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:51.253070 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-38a24b61-849e-4806-90d2-aab755a47043 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159708 May 03 21:32:51.257015 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 260/560] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 3 21:32:51 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:32:51.287366 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-0635b327-d593-4ac8-b9af-8b5d249a28e2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:51.288047 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-0635b327-d593-4ac8-b9af-8b5d249a28e2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:51.296364 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0635b327-d593-4ac8-b9af-8b5d249a28e2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:51.297285 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0635b327-d593-4ac8-b9af-8b5d249a28e2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:51.298272 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0635b327-d593-4ac8-b9af-8b5d249a28e2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:51.298893 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0635b327-d593-4ac8-b9af-8b5d249a28e2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:51.768869 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-0635b327-d593-4ac8-b9af-8b5d249a28e2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:51.793740 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-0635b327-d593-4ac8-b9af-8b5d249a28e2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1736 microversion: 2.1 time: 0.517837 May 03 21:32:51.800551 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 301/561] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:51 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1736 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:51.846480 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-9720ed67-a0b7-4fee-a6ae-85a10cc8bcf7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:51.847183 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-9720ed67-a0b7-4fee-a6ae-85a10cc8bcf7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:51.869202 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9720ed67-a0b7-4fee-a6ae-85a10cc8bcf7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:51.869661 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9720ed67-a0b7-4fee-a6ae-85a10cc8bcf7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:51.875905 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9720ed67-a0b7-4fee-a6ae-85a10cc8bcf7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:51.876364 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9720ed67-a0b7-4fee-a6ae-85a10cc8bcf7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:52.110027 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-9720ed67-a0b7-4fee-a6ae-85a10cc8bcf7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:52.120591 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-9720ed67-a0b7-4fee-a6ae-85a10cc8bcf7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1676 microversion: 2.1 time: 0.314805 May 03 21:32:52.132146 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 261/562] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:51 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1676 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:52.273321 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-25b9675b-47bd-4897-8b78-b5759d24e8d4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:52.274279 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-25b9675b-47bd-4897-8b78-b5759d24e8d4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:52.283162 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-25b9675b-47bd-4897-8b78-b5759d24e8d4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:52.283615 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-25b9675b-47bd-4897-8b78-b5759d24e8d4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:52.284410 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-25b9675b-47bd-4897-8b78-b5759d24e8d4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:52.284898 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-25b9675b-47bd-4897-8b78-b5759d24e8d4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:52.361110 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-25b9675b-47bd-4897-8b78-b5759d24e8d4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098120 May 03 21:32:52.365984 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 302/563] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 3 21:32:52 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:32:52.822961 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-9e92b83a-bf78-42e1-82de-19849fd9d774 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:52.823578 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-9e92b83a-bf78-42e1-82de-19849fd9d774 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:52.834538 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9e92b83a-bf78-42e1-82de-19849fd9d774 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:52.834987 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9e92b83a-bf78-42e1-82de-19849fd9d774 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:52.835786 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9e92b83a-bf78-42e1-82de-19849fd9d774 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:52.836212 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9e92b83a-bf78-42e1-82de-19849fd9d774 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:53.061545 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-9e92b83a-bf78-42e1-82de-19849fd9d774 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:53.071920 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-9e92b83a-bf78-42e1-82de-19849fd9d774 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1736 microversion: 2.1 time: 0.258200 May 03 21:32:53.072509 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 262/564] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:52 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1736 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:53.147282 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-95739901-e482-4617-8fe1-46f512e01eeb tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:53.148273 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-95739901-e482-4617-8fe1-46f512e01eeb tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:53.157331 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-95739901-e482-4617-8fe1-46f512e01eeb tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:53.158009 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-95739901-e482-4617-8fe1-46f512e01eeb tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:53.159219 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-95739901-e482-4617-8fe1-46f512e01eeb tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:53.159439 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-95739901-e482-4617-8fe1-46f512e01eeb tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:53.410060 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-daf06ff7-7147-40ae-acdc-cae6972ccd30 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:53.413397 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-daf06ff7-7147-40ae-acdc-cae6972ccd30 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:53.431200 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-daf06ff7-7147-40ae-acdc-cae6972ccd30 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:53.432343 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-daf06ff7-7147-40ae-acdc-cae6972ccd30 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:53.433982 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-daf06ff7-7147-40ae-acdc-cae6972ccd30 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:53.434947 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-daf06ff7-7147-40ae-acdc-cae6972ccd30 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:53.516929 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-95739901-e482-4617-8fe1-46f512e01eeb tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:53.530875 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-95739901-e482-4617-8fe1-46f512e01eeb tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1676 microversion: 2.1 time: 0.395137 May 03 21:32:53.532887 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 303/565] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:53 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1676 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:32:53.583650 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-daf06ff7-7147-40ae-acdc-cae6972ccd30 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.213454 May 03 21:32:53.584749 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 263/566] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 3 21:32:53 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14/os-volume_attachments => generated 25 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 03 21:32:53.732503 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-daadb5e5-9e4b-4f3f-9998-339f4ed55e2b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:53.733243 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-daadb5e5-9e4b-4f3f-9998-339f4ed55e2b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:53.741703 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-daadb5e5-9e4b-4f3f-9998-339f4ed55e2b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:53.742188 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-daadb5e5-9e4b-4f3f-9998-339f4ed55e2b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:53.743014 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-daadb5e5-9e4b-4f3f-9998-339f4ed55e2b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:53.743450 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-daadb5e5-9e4b-4f3f-9998-339f4ed55e2b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:53.822240 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-daadb5e5-9e4b-4f3f-9998-339f4ed55e2b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Going to try to terminate instance {{(pid=97832) delete /opt/stack/nova/nova/compute/api.py:2559}} May 03 21:32:54.110147 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-dc92c48a-1c88-4d35-ac1d-9257be26ce90 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:54.110841 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-dc92c48a-1c88-4d35-ac1d-9257be26ce90 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:54.123990 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-dc92c48a-1c88-4d35-ac1d-9257be26ce90 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:54.125906 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-dc92c48a-1c88-4d35-ac1d-9257be26ce90 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:54.127096 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-dc92c48a-1c88-4d35-ac1d-9257be26ce90 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:54.127747 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-dc92c48a-1c88-4d35-ac1d-9257be26ce90 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:54.262435 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-daadb5e5-9e4b-4f3f-9998-339f4ed55e2b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "DELETE /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14" status: 204 len: 0 microversion: 2.1 time: 0.542677 May 03 21:32:54.263246 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 304/567] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 3 21:32:53 2022] DELETE /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 03 21:32:54.280147 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-fe879ac1-932c-4a9d-bf12-027017f5ab83 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:54.282837 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-fe879ac1-932c-4a9d-bf12-027017f5ab83 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:54.292681 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fe879ac1-932c-4a9d-bf12-027017f5ab83 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:54.293785 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fe879ac1-932c-4a9d-bf12-027017f5ab83 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:54.294706 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fe879ac1-932c-4a9d-bf12-027017f5ab83 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:54.295248 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fe879ac1-932c-4a9d-bf12-027017f5ab83 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:54.418751 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-dc92c48a-1c88-4d35-ac1d-9257be26ce90 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:54.450479 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-dc92c48a-1c88-4d35-ac1d-9257be26ce90 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1736 microversion: 2.1 time: 0.362897 May 03 21:32:54.464459 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 264/568] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:54 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1736 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:32:54.571329 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-adb18983-0a8a-4ab9-81f7-89b8f24dd04c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:54.572056 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-adb18983-0a8a-4ab9-81f7-89b8f24dd04c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:54.579362 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-adb18983-0a8a-4ab9-81f7-89b8f24dd04c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:54.580125 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-adb18983-0a8a-4ab9-81f7-89b8f24dd04c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:54.581156 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-adb18983-0a8a-4ab9-81f7-89b8f24dd04c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:54.581673 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-adb18983-0a8a-4ab9-81f7-89b8f24dd04c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:54.826566 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-fe879ac1-932c-4a9d-bf12-027017f5ab83 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:54.841822 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-fe879ac1-932c-4a9d-bf12-027017f5ab83 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14" status: 200 len: 1682 microversion: 2.1 time: 0.573928 May 03 21:32:54.843686 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 305/569] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:54 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14 => generated 1682 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:32:54.855616 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-96ee70c5-e8ec-4040-87bd-3fa9c70a23ac tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Action: 'create', calling method: .version_select at 0x7fc84cce6ee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1248110149"}} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:32:54.860333 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-adb18983-0a8a-4ab9-81f7-89b8f24dd04c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:54.873101 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-adb18983-0a8a-4ab9-81f7-89b8f24dd04c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1676 microversion: 2.1 time: 0.314256 May 03 21:32:54.874116 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 265/570] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:54 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1676 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:54.886843 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-96ee70c5-e8ec-4040-87bd-3fa9c70a23ac tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Getting quotas for project 03af834dfea4426086d2125bcea03d0f. Resources: {'key_pairs'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:32:54.891419 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-96ee70c5-e8ec-4040-87bd-3fa9c70a23ac tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Getting quotas for user ac934f8b0ffc4d3ea5e32f2295de9741 and project 03af834dfea4426086d2125bcea03d0f. Resources: {'key_pairs'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:32:55.193650 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-96ee70c5-e8ec-4040-87bd-3fa9c70a23ac tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Getting quotas for project 03af834dfea4426086d2125bcea03d0f. Resources: {'key_pairs'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:32:55.204712 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-96ee70c5-e8ec-4040-87bd-3fa9c70a23ac tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Getting quotas for user ac934f8b0ffc4d3ea5e32f2295de9741 and project 03af834dfea4426086d2125bcea03d0f. Resources: {'key_pairs'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:32:55.221992 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-96ee70c5-e8ec-4040-87bd-3fa9c70a23ac tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.376249 May 03 21:32:55.223648 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 306/571] 10.222.0.48 () {60 vars in 1157 bytes} [Tue May 3 21:32:54 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:55.298532 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-47834467-1452-41a3-a1d8-1f4c7fccea57 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-620500539", "imageRef": "ffccf259-e9a9-44c3-875c-c50e93063b3f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1248110149", "networks": [{"uuid": "9b51a3a3-5ba7-4915-a72e-fc06fbab7914"}]}} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:32:55.388062 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.network.neutron [None req-47834467-1452-41a3-a1d8-1f4c7fccea57 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] validate_networks() for [('9b51a3a3-5ba7-4915-a72e-fc06fbab7914', None, None, None)] {{(pid=97831) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} May 03 21:32:55.480930 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-97527fbd-110d-4e96-81e0-e317d3b7802c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:55.489411 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-97527fbd-110d-4e96-81e0-e317d3b7802c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:55.507142 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-97527fbd-110d-4e96-81e0-e317d3b7802c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:55.507142 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-97527fbd-110d-4e96-81e0-e317d3b7802c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:55.507964 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-97527fbd-110d-4e96-81e0-e317d3b7802c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:55.508666 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-97527fbd-110d-4e96-81e0-e317d3b7802c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:55.850782 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-97527fbd-110d-4e96-81e0-e317d3b7802c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:55.864573 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-97527fbd-110d-4e96-81e0-e317d3b7802c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1736 microversion: 2.1 time: 0.399329 May 03 21:32:55.865689 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 307/572] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:55 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1736 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:55.877738 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-712211a5-2a5b-47b9-a8d3-3ea2fcf5238e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:55.878445 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-712211a5-2a5b-47b9-a8d3-3ea2fcf5238e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:55.889923 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-712211a5-2a5b-47b9-a8d3-3ea2fcf5238e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:55.890654 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-712211a5-2a5b-47b9-a8d3-3ea2fcf5238e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:55.892305 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-712211a5-2a5b-47b9-a8d3-3ea2fcf5238e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:55.893143 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-712211a5-2a5b-47b9-a8d3-3ea2fcf5238e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:56.245683 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-712211a5-2a5b-47b9-a8d3-3ea2fcf5238e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:56.262042 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-712211a5-2a5b-47b9-a8d3-3ea2fcf5238e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14" status: 200 len: 1682 microversion: 2.1 time: 0.394765 May 03 21:32:56.273299 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 308/573] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:55 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14 => generated 1682 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:56.283841 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-66219a2c-de4b-4766-8109-26cb0187de5e tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:56.284595 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-66219a2c-de4b-4766-8109-26cb0187de5e tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:56.293355 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-66219a2c-de4b-4766-8109-26cb0187de5e tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:56.293806 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-66219a2c-de4b-4766-8109-26cb0187de5e tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:56.297073 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-66219a2c-de4b-4766-8109-26cb0187de5e tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:56.297073 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-66219a2c-de4b-4766-8109-26cb0187de5e tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:56.392503 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-47834467-1452-41a3-a1d8-1f4c7fccea57 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Flavor limits 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} May 03 21:32:56.393944 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-47834467-1452-41a3-a1d8-1f4c7fccea57 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Image limits 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} May 03 21:32:56.395092 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-47834467-1452-41a3-a1d8-1f4c7fccea57 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Flavor pref 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} May 03 21:32:56.395926 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-47834467-1452-41a3-a1d8-1f4c7fccea57 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Image pref 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} May 03 21:32:56.396599 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-47834467-1452-41a3-a1d8-1f4c7fccea57 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} May 03 21:32:56.411828 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-47834467-1452-41a3-a1d8-1f4c7fccea57 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:56.413069 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-47834467-1452-41a3-a1d8-1f4c7fccea57 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:56.414875 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-47834467-1452-41a3-a1d8-1f4c7fccea57 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:56.415320 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-47834467-1452-41a3-a1d8-1f4c7fccea57 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:56.437294 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-47834467-1452-41a3-a1d8-1f4c7fccea57 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Getting quotas for project 03af834dfea4426086d2125bcea03d0f. Resources: {'instances', 'ram', 'cores'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:32:56.451811 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-47834467-1452-41a3-a1d8-1f4c7fccea57 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Getting quotas for user ac934f8b0ffc4d3ea5e32f2295de9741 and project 03af834dfea4426086d2125bcea03d0f. Resources: {'instances', 'ram', 'cores'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:32:56.481331 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-47834467-1452-41a3-a1d8-1f4c7fccea57 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Going to run 1 instances... {{(pid=97831) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} May 03 21:32:56.484045 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-47834467-1452-41a3-a1d8-1f4c7fccea57 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ffccf259-e9a9-44c3-875c-c50e93063b3f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=97831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} May 03 21:32:56.586532 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-66219a2c-de4b-4766-8109-26cb0187de5e tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:56.601911 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-66219a2c-de4b-4766-8109-26cb0187de5e tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1676 microversion: 2.1 time: 0.327270 May 03 21:32:56.602860 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 309/574] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:56 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1676 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:56.627140 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-47834467-1452-41a3-a1d8-1f4c7fccea57 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.337898 May 03 21:32:56.634886 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 266/575] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 3 21:32:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1346 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 03 21:32:56.673224 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-d59aa897-d0fb-4605-98aa-f76aeb4f9cff tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:56.674259 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-d59aa897-d0fb-4605-98aa-f76aeb4f9cff tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:56.892200 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-8d922695-395c-499e-a035-adfadd7dee61 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:56.893131 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-8d922695-395c-499e-a035-adfadd7dee61 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:56.904336 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8d922695-395c-499e-a035-adfadd7dee61 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:56.904579 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8d922695-395c-499e-a035-adfadd7dee61 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:56.905254 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8d922695-395c-499e-a035-adfadd7dee61 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:56.905702 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8d922695-395c-499e-a035-adfadd7dee61 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:56.938364 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-d59aa897-d0fb-4605-98aa-f76aeb4f9cff tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:56.953229 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-d59aa897-d0fb-4605-98aa-f76aeb4f9cff tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1258 microversion: 2.1 time: 0.317621 May 03 21:32:56.953794 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 310/576] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:56 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1258 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:57.151663 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-8d922695-395c-499e-a035-adfadd7dee61 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:57.161991 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-8d922695-395c-499e-a035-adfadd7dee61 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1736 microversion: 2.1 time: 0.278850 May 03 21:32:57.162882 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 267/577] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:56 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1736 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:57.287061 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-91b214ce-ea25-476f-b167-02a25df673c2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:57.287701 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-91b214ce-ea25-476f-b167-02a25df673c2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:57.298229 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-91b214ce-ea25-476f-b167-02a25df673c2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:57.298720 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-91b214ce-ea25-476f-b167-02a25df673c2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:57.299500 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-91b214ce-ea25-476f-b167-02a25df673c2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:57.299940 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-91b214ce-ea25-476f-b167-02a25df673c2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:57.554041 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-91b214ce-ea25-476f-b167-02a25df673c2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:57.564131 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-91b214ce-ea25-476f-b167-02a25df673c2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14" status: 200 len: 1682 microversion: 2.1 time: 0.287843 May 03 21:32:57.565538 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 311/578] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:57 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14 => generated 1682 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:57.634599 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-f6fa2579-bc14-425a-ae03-8308491adf3d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:57.635229 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-f6fa2579-bc14-425a-ae03-8308491adf3d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:57.646251 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f6fa2579-bc14-425a-ae03-8308491adf3d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:57.647114 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f6fa2579-bc14-425a-ae03-8308491adf3d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:57.648492 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f6fa2579-bc14-425a-ae03-8308491adf3d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:57.649023 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f6fa2579-bc14-425a-ae03-8308491adf3d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:57.981765 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-fccf7cc0-5f4d-4962-bab2-255e672b8996 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:57.983188 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-fccf7cc0-5f4d-4962-bab2-255e672b8996 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:57.991665 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-f6fa2579-bc14-425a-ae03-8308491adf3d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:58.002557 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-f6fa2579-bc14-425a-ae03-8308491adf3d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1653 microversion: 2.1 time: 0.379690 May 03 21:32:58.003533 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 268/579] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:57 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1653 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:58.027208 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-6755cf0b-d53a-4a29-952c-b8cb09606c63 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:32:58.035475 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6755cf0b-d53a-4a29-952c-b8cb09606c63 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:58.036174 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6755cf0b-d53a-4a29-952c-b8cb09606c63 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:58.132884 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-fccf7cc0-5f4d-4962-bab2-255e672b8996 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:58.149748 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-6755cf0b-d53a-4a29-952c-b8cb09606c63 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Going to try to start instance {{(pid=97831) start /opt/stack/nova/nova/compute/api.py:2622}} May 03 21:32:58.156301 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-fccf7cc0-5f4d-4962-bab2-255e672b8996 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1258 microversion: 2.1 time: 0.188729 May 03 21:32:58.157268 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 312/580] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:57 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1258 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:32:58.190955 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-08fbe448-79e6-4f7a-8808-7c551429980f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:58.192473 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-08fbe448-79e6-4f7a-8808-7c551429980f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:58.200986 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-08fbe448-79e6-4f7a-8808-7c551429980f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:58.201746 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-08fbe448-79e6-4f7a-8808-7c551429980f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:58.206071 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-08fbe448-79e6-4f7a-8808-7c551429980f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:58.206071 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-08fbe448-79e6-4f7a-8808-7c551429980f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:58.386037 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-6755cf0b-d53a-4a29-952c-b8cb09606c63 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "POST /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a/action" status: 202 len: 0 microversion: 2.1 time: 0.368815 May 03 21:32:58.386896 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 269/581] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 3 21:32:58 2022] POST /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 21:32:58.410379 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-672b2ffb-a3fb-4bbf-afb1-ca79f054054c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:58.411428 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-672b2ffb-a3fb-4bbf-afb1-ca79f054054c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:58.421083 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-672b2ffb-a3fb-4bbf-afb1-ca79f054054c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:58.421830 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-672b2ffb-a3fb-4bbf-afb1-ca79f054054c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:58.422770 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-672b2ffb-a3fb-4bbf-afb1-ca79f054054c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:58.423393 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-672b2ffb-a3fb-4bbf-afb1-ca79f054054c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:58.466466 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-08fbe448-79e6-4f7a-8808-7c551429980f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:58.485391 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-08fbe448-79e6-4f7a-8808-7c551429980f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1736 microversion: 2.1 time: 0.309535 May 03 21:32:58.486313 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 313/582] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:58 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1736 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:32:58.594927 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-738a9ded-9208-478c-92c2-a55cfbea171c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:58.595880 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-738a9ded-9208-478c-92c2-a55cfbea171c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:58.614163 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-738a9ded-9208-478c-92c2-a55cfbea171c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:58.614163 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-738a9ded-9208-478c-92c2-a55cfbea171c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:58.615498 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-738a9ded-9208-478c-92c2-a55cfbea171c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:58.616473 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-738a9ded-9208-478c-92c2-a55cfbea171c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:58.733642 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-672b2ffb-a3fb-4bbf-afb1-ca79f054054c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:58.746029 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-672b2ffb-a3fb-4bbf-afb1-ca79f054054c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1662 microversion: 2.1 time: 0.354060 May 03 21:32:58.748146 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 270/583] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:58 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1662 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:58.924893 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-738a9ded-9208-478c-92c2-a55cfbea171c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:58.934062 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-738a9ded-9208-478c-92c2-a55cfbea171c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14" status: 200 len: 1682 microversion: 2.1 time: 0.351233 May 03 21:32:58.935035 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 314/584] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:58 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14 => generated 1682 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:59.186398 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-2ac64fc9-60ca-4149-af33-c280ad93de76 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:59.187139 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-2ac64fc9-60ca-4149-af33-c280ad93de76 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:59.196085 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2ac64fc9-60ca-4149-af33-c280ad93de76 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:59.197012 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2ac64fc9-60ca-4149-af33-c280ad93de76 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:59.198491 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2ac64fc9-60ca-4149-af33-c280ad93de76 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:59.199283 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2ac64fc9-60ca-4149-af33-c280ad93de76 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:59.351958 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-2ac64fc9-60ca-4149-af33-c280ad93de76 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:59.361473 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-2ac64fc9-60ca-4149-af33-c280ad93de76 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1262 microversion: 2.1 time: 0.190585 May 03 21:32:59.371323 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 271/585] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:59 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1262 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:59.515210 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-4e5803f1-b111-4d01-8fed-b42520df83e0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:59.516307 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-4e5803f1-b111-4d01-8fed-b42520df83e0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:59.527132 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4e5803f1-b111-4d01-8fed-b42520df83e0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:59.527701 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4e5803f1-b111-4d01-8fed-b42520df83e0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:59.528573 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4e5803f1-b111-4d01-8fed-b42520df83e0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:59.529086 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4e5803f1-b111-4d01-8fed-b42520df83e0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:59.777338 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-2300e2a9-a6f2-4f8c-a03f-74620143836a tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:59.779482 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-2300e2a9-a6f2-4f8c-a03f-74620143836a tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:59.786817 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2300e2a9-a6f2-4f8c-a03f-74620143836a tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:59.787272 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2300e2a9-a6f2-4f8c-a03f-74620143836a tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:59.788096 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2300e2a9-a6f2-4f8c-a03f-74620143836a tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:59.788562 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2300e2a9-a6f2-4f8c-a03f-74620143836a tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:59.796906 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-4e5803f1-b111-4d01-8fed-b42520df83e0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:32:59.810699 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-4e5803f1-b111-4d01-8fed-b42520df83e0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1736 microversion: 2.1 time: 0.309544 May 03 21:32:59.812150 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 315/586] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:59 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1736 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:32:59.962017 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-55052d1f-5dd1-4729-8ea9-6a620ffcb238 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:32:59.968003 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-55052d1f-5dd1-4729-8ea9-6a620ffcb238 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:32:59.982552 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-55052d1f-5dd1-4729-8ea9-6a620ffcb238 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:59.983525 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-55052d1f-5dd1-4729-8ea9-6a620ffcb238 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:32:59.985110 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-55052d1f-5dd1-4729-8ea9-6a620ffcb238 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:32:59.985947 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-55052d1f-5dd1-4729-8ea9-6a620ffcb238 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:00.181393 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-2300e2a9-a6f2-4f8c-a03f-74620143836a tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:00.193821 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-2300e2a9-a6f2-4f8c-a03f-74620143836a tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1662 microversion: 2.1 time: 0.430402 May 03 21:33:00.195200 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 272/587] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:59 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1662 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:33:00.297788 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-55052d1f-5dd1-4729-8ea9-6a620ffcb238 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:00.307343 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-55052d1f-5dd1-4729-8ea9-6a620ffcb238 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14" status: 200 len: 1682 microversion: 2.1 time: 0.356558 May 03 21:33:00.307921 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 316/588] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:32:59 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14 => generated 1682 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:00.385274 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-e55da6e4-9c00-4510-9f25-3209c183ee0d tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:00.385985 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-e55da6e4-9c00-4510-9f25-3209c183ee0d tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:00.394110 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e55da6e4-9c00-4510-9f25-3209c183ee0d tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:00.395515 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e55da6e4-9c00-4510-9f25-3209c183ee0d tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:00.396722 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e55da6e4-9c00-4510-9f25-3209c183ee0d tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:00.397172 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e55da6e4-9c00-4510-9f25-3209c183ee0d tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:00.526903 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-e55da6e4-9c00-4510-9f25-3209c183ee0d tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:00.536178 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-e55da6e4-9c00-4510-9f25-3209c183ee0d tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1262 microversion: 2.1 time: 0.159860 May 03 21:33:00.537170 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 273/589] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:00 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1262 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:00.835310 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-2bf44904-6331-4d09-8946-9e9c0d524e1f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:00.836065 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-2bf44904-6331-4d09-8946-9e9c0d524e1f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:00.843604 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2bf44904-6331-4d09-8946-9e9c0d524e1f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:00.844041 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2bf44904-6331-4d09-8946-9e9c0d524e1f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:00.844839 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2bf44904-6331-4d09-8946-9e9c0d524e1f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:00.845262 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2bf44904-6331-4d09-8946-9e9c0d524e1f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:01.087848 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-2bf44904-6331-4d09-8946-9e9c0d524e1f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:01.105448 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-2bf44904-6331-4d09-8946-9e9c0d524e1f tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1736 microversion: 2.1 time: 0.279657 May 03 21:33:01.117637 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 317/590] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:00 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1736 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:01.218257 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-74990dd8-4ccd-4e3d-8d75-15012ee00e56 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:01.218872 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-74990dd8-4ccd-4e3d-8d75-15012ee00e56 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:01.231718 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-74990dd8-4ccd-4e3d-8d75-15012ee00e56 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:01.232246 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-74990dd8-4ccd-4e3d-8d75-15012ee00e56 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:01.237692 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-74990dd8-4ccd-4e3d-8d75-15012ee00e56 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:01.237692 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-74990dd8-4ccd-4e3d-8d75-15012ee00e56 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:01.331526 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-85789c54-048a-4398-a662-8132bbe8bf34 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:01.337687 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-85789c54-048a-4398-a662-8132bbe8bf34 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:01.352545 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-85789c54-048a-4398-a662-8132bbe8bf34 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:01.358140 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-85789c54-048a-4398-a662-8132bbe8bf34 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:01.359107 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-85789c54-048a-4398-a662-8132bbe8bf34 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:01.359385 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-85789c54-048a-4398-a662-8132bbe8bf34 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:01.638937 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-85789c54-048a-4398-a662-8132bbe8bf34 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:01.656178 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-85789c54-048a-4398-a662-8132bbe8bf34 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14" status: 200 len: 1682 microversion: 2.1 time: 0.334228 May 03 21:33:01.658030 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 318/591] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:01 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14 => generated 1682 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:33:01.681100 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-b07eb040-9ec8-4679-9c19-b0b10e1046b6 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:01.682668 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-b07eb040-9ec8-4679-9c19-b0b10e1046b6 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:01.689827 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b07eb040-9ec8-4679-9c19-b0b10e1046b6 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:01.690277 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b07eb040-9ec8-4679-9c19-b0b10e1046b6 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:01.691055 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b07eb040-9ec8-4679-9c19-b0b10e1046b6 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:01.691538 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b07eb040-9ec8-4679-9c19-b0b10e1046b6 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:01.836853 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-b07eb040-9ec8-4679-9c19-b0b10e1046b6 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:01.857343 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-b07eb040-9ec8-4679-9c19-b0b10e1046b6 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1254 microversion: 2.1 time: 0.188138 May 03 21:33:01.867938 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 319/592] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:01 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1254 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:01.902017 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-74990dd8-4ccd-4e3d-8d75-15012ee00e56 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:01.927167 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-74990dd8-4ccd-4e3d-8d75-15012ee00e56 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1662 microversion: 2.1 time: 0.718685 May 03 21:33:01.941743 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 274/593] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:01 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1662 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:02.180455 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-32a5e0a7-4b92-4834-baed-c89afce55e45 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:02.181383 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-32a5e0a7-4b92-4834-baed-c89afce55e45 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:02.206548 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-32a5e0a7-4b92-4834-baed-c89afce55e45 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:02.211396 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-32a5e0a7-4b92-4834-baed-c89afce55e45 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:02.217550 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-32a5e0a7-4b92-4834-baed-c89afce55e45 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:02.218558 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-32a5e0a7-4b92-4834-baed-c89afce55e45 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:02.673261 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-32a5e0a7-4b92-4834-baed-c89afce55e45 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:02.687216 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-8ba362b4-8f25-4721-bf75-76b552d97b58 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:02.691750 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-8ba362b4-8f25-4721-bf75-76b552d97b58 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:02.701175 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-32a5e0a7-4b92-4834-baed-c89afce55e45 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1736 microversion: 2.1 time: 0.570875 May 03 21:33:02.702680 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 320/594] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:02 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1736 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:02.713555 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8ba362b4-8f25-4721-bf75-76b552d97b58 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:02.714031 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8ba362b4-8f25-4721-bf75-76b552d97b58 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:02.714901 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8ba362b4-8f25-4721-bf75-76b552d97b58 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:02.715332 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8ba362b4-8f25-4721-bf75-76b552d97b58 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:02.881422 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-b3859230-1c61-40cc-a2b0-24e8b8bb1edb tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:02.882005 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-b3859230-1c61-40cc-a2b0-24e8b8bb1edb tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:02.907392 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b3859230-1c61-40cc-a2b0-24e8b8bb1edb tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:02.907846 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b3859230-1c61-40cc-a2b0-24e8b8bb1edb tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:02.908731 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b3859230-1c61-40cc-a2b0-24e8b8bb1edb tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:02.909328 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b3859230-1c61-40cc-a2b0-24e8b8bb1edb tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:03.122466 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-b3859230-1c61-40cc-a2b0-24e8b8bb1edb tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:03.182179 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-b3859230-1c61-40cc-a2b0-24e8b8bb1edb tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1310 microversion: 2.1 time: 0.300801 May 03 21:33:03.184547 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 321/595] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:02 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1310 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:33:03.218053 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-e13844f8-b05a-4dd1-8dd6-be813cb15ac8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:03.218999 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-e13844f8-b05a-4dd1-8dd6-be813cb15ac8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:03.238912 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e13844f8-b05a-4dd1-8dd6-be813cb15ac8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:03.243723 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e13844f8-b05a-4dd1-8dd6-be813cb15ac8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:03.248861 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e13844f8-b05a-4dd1-8dd6-be813cb15ac8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:03.254576 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e13844f8-b05a-4dd1-8dd6-be813cb15ac8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:03.746162 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-8ba362b4-8f25-4721-bf75-76b552d97b58 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:03.762359 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-e13844f8-b05a-4dd1-8dd6-be813cb15ac8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:03.776494 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-e13844f8-b05a-4dd1-8dd6-be813cb15ac8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1662 microversion: 2.1 time: 0.590626 May 03 21:33:03.788626 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-8ba362b4-8f25-4721-bf75-76b552d97b58 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14" status: 200 len: 1682 microversion: 2.1 time: 1.113490 May 03 21:33:03.792808 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 275/597] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:02 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14 => generated 1682 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:33:03.816219 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-c2430f3f-b820-40ac-986f-14d769bda634 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:03.817283 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-c2430f3f-b820-40ac-986f-14d769bda634 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:03.840803 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 322/597] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:03 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1662 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:03.840910 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c2430f3f-b820-40ac-986f-14d769bda634 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:03.840910 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c2430f3f-b820-40ac-986f-14d769bda634 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:03.840910 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c2430f3f-b820-40ac-986f-14d769bda634 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:03.840910 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c2430f3f-b820-40ac-986f-14d769bda634 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:04.213742 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-7195445a-3a57-4589-a375-278e05c45d4a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:04.215834 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-7195445a-3a57-4589-a375-278e05c45d4a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:04.231825 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7195445a-3a57-4589-a375-278e05c45d4a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:04.234256 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7195445a-3a57-4589-a375-278e05c45d4a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:04.236865 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7195445a-3a57-4589-a375-278e05c45d4a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:04.238274 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7195445a-3a57-4589-a375-278e05c45d4a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:04.471299 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-7195445a-3a57-4589-a375-278e05c45d4a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:04.480052 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-c2430f3f-b820-40ac-986f-14d769bda634 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:04.498030 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-7195445a-3a57-4589-a375-278e05c45d4a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1316 microversion: 2.1 time: 0.293822 May 03 21:33:04.504640 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-c2430f3f-b820-40ac-986f-14d769bda634 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1716 microversion: 2.1 time: 0.709335 May 03 21:33:04.517260 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 323/598] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:04 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1316 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:33:04.517574 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 276/599] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:03 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1716 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:04.733050 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-ecf0232c-c1b6-4a18-b0ef-6ca53fede6c1 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:04.734521 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-ecf0232c-c1b6-4a18-b0ef-6ca53fede6c1 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:04.747152 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ecf0232c-c1b6-4a18-b0ef-6ca53fede6c1 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:04.748287 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ecf0232c-c1b6-4a18-b0ef-6ca53fede6c1 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:04.750005 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ecf0232c-c1b6-4a18-b0ef-6ca53fede6c1 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:04.751007 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ecf0232c-c1b6-4a18-b0ef-6ca53fede6c1 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:04.806978 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-05d8d8a2-3cc8-4a56-bab4-b685a1d36570 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:04.809455 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-05d8d8a2-3cc8-4a56-bab4-b685a1d36570 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:04.828731 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-05d8d8a2-3cc8-4a56-bab4-b685a1d36570 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:04.829607 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-05d8d8a2-3cc8-4a56-bab4-b685a1d36570 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:04.834343 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-05d8d8a2-3cc8-4a56-bab4-b685a1d36570 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:04.835717 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-05d8d8a2-3cc8-4a56-bab4-b685a1d36570 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:05.167938 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.wsgi [None req-ecf0232c-c1b6-4a18-b0ef-6ca53fede6c1 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] HTTP exception thrown: Cannot 'detach_volume' instance cb2b9b5d-640a-401a-ac60-566b6d8dbc52 while it is in vm_state rescued May 03 21:33:05.168637 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-ecf0232c-c1b6-4a18-b0ef-6ca53fede6c1 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Returning 409 to user: Cannot 'detach_volume' instance cb2b9b5d-640a-401a-ac60-566b6d8dbc52 while it is in vm_state rescued {{(pid=97832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:33:05.169421 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-ecf0232c-c1b6-4a18-b0ef-6ca53fede6c1 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52/os-volume_attachments/c9b7a540-3b03-4517-9746-6799e6107dba" status: 409 len: 152 microversion: 2.1 time: 0.448057 May 03 21:33:05.173577 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 324/600] 10.222.0.48 () {58 vars in 1415 bytes} [Tue May 3 21:33:04 2022] DELETE /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52/os-volume_attachments/c9b7a540-3b03-4517-9746-6799e6107dba => generated 152 bytes in 453 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 03 21:33:05.204739 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-f8b2be50-3ea8-4047-9fcd-5610ee340e73 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:05.205359 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-f8b2be50-3ea8-4047-9fcd-5610ee340e73 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:05.241113 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f8b2be50-3ea8-4047-9fcd-5610ee340e73 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:05.242206 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f8b2be50-3ea8-4047-9fcd-5610ee340e73 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:05.249145 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f8b2be50-3ea8-4047-9fcd-5610ee340e73 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:05.250241 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f8b2be50-3ea8-4047-9fcd-5610ee340e73 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:05.494219 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-f8b2be50-3ea8-4047-9fcd-5610ee340e73 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:05.517580 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-f8b2be50-3ea8-4047-9fcd-5610ee340e73 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14" status: 200 len: 1614 microversion: 2.1 time: 0.342661 May 03 21:33:05.518475 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 325/601] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:05 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14 => generated 1614 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:05.541164 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-cafecf5d-b294-4a16-ac62-5ea68db425f2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:33:05.542939 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-cafecf5d-b294-4a16-ac62-5ea68db425f2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:05.563913 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cafecf5d-b294-4a16-ac62-5ea68db425f2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:05.564713 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cafecf5d-b294-4a16-ac62-5ea68db425f2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:05.565734 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cafecf5d-b294-4a16-ac62-5ea68db425f2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:05.566939 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cafecf5d-b294-4a16-ac62-5ea68db425f2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:06.114006 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-cafecf5d-b294-4a16-ac62-5ea68db425f2 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "POST /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52/action" status: 202 len: 0 microversion: 2.1 time: 0.591316 May 03 21:33:06.132722 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 326/602] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 3 21:33:05 2022] POST /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52/action => generated 0 bytes in 613 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 21:33:06.178816 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-a47106dc-ced3-4f7b-8944-8b85f550e91d tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:06.185487 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-a47106dc-ced3-4f7b-8944-8b85f550e91d tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:06.231352 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a47106dc-ced3-4f7b-8944-8b85f550e91d tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:06.242937 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a47106dc-ced3-4f7b-8944-8b85f550e91d tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:06.247367 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a47106dc-ced3-4f7b-8944-8b85f550e91d tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:06.249327 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a47106dc-ced3-4f7b-8944-8b85f550e91d tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:06.397530 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-05d8d8a2-3cc8-4a56-bab4-b685a1d36570 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:06.457404 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-05d8d8a2-3cc8-4a56-bab4-b685a1d36570 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1662 microversion: 2.1 time: 1.659325 May 03 21:33:06.459537 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 277/603] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:04 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1662 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:33:06.504193 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-c712e5f7-5303-451e-94c0-1988746e5e9c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:06.512343 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-c712e5f7-5303-451e-94c0-1988746e5e9c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:06.553167 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c712e5f7-5303-451e-94c0-1988746e5e9c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:06.553698 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c712e5f7-5303-451e-94c0-1988746e5e9c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:06.554663 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c712e5f7-5303-451e-94c0-1988746e5e9c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:06.559624 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c712e5f7-5303-451e-94c0-1988746e5e9c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:07.020331 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-a47106dc-ced3-4f7b-8944-8b85f550e91d tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:07.070722 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-a47106dc-ced3-4f7b-8944-8b85f550e91d tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1358 microversion: 2.1 time: 0.933456 May 03 21:33:07.071725 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 327/604] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:06 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1358 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:07.089635 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-ba76d76d-cd45-46e2-be28-8433c6f47ff4 req-868e8b64-5afd-48b2-9829-7ea587ef436c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12a46337-1502-4a61-8c0d-8b5dd98d5a14", "name": "network-vif-deleted", "tag": "5c8533bd-9029-4055-8bb5-b5628053505e"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:33:07.098237 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:33:07.098237 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:33:07.109750 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-ba76d76d-cd45-46e2-be28-8433c6f47ff4 req-868e8b64-5afd-48b2-9829-7ea587ef436c service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:07.110200 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-ba76d76d-cd45-46e2-be28-8433c6f47ff4 req-868e8b64-5afd-48b2-9829-7ea587ef436c service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:07.131602 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-ba76d76d-cd45-46e2-be28-8433c6f47ff4 req-868e8b64-5afd-48b2-9829-7ea587ef436c service nova] Creating event network-vif-deleted:5c8533bd-9029-4055-8bb5-b5628053505e for instance 12a46337-1502-4a61-8c0d-8b5dd98d5a14 on hv-cinder-84037 May 03 21:33:07.137176 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-ba76d76d-cd45-46e2-be28-8433c6f47ff4 req-868e8b64-5afd-48b2-9829-7ea587ef436c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063814 May 03 21:33:07.138577 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 328/605] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:33:07.163403 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-48936bca-f409-433d-b8ab-24e7e01cf24a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:07.164342 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-48936bca-f409-433d-b8ab-24e7e01cf24a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:07.177528 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-48936bca-f409-433d-b8ab-24e7e01cf24a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:07.177528 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-48936bca-f409-433d-b8ab-24e7e01cf24a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:07.177528 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-48936bca-f409-433d-b8ab-24e7e01cf24a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:07.177528 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-48936bca-f409-433d-b8ab-24e7e01cf24a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:07.190491 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-c712e5f7-5303-451e-94c0-1988746e5e9c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:07.200212 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-c712e5f7-5303-451e-94c0-1988746e5e9c tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1724 microversion: 2.1 time: 0.739195 May 03 21:33:07.210874 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 278/606] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:06 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1724 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:07.221975 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-1f2c074a-3219-4284-bd8f-5ced982dff1b tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:07.223228 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-1f2c074a-3219-4284-bd8f-5ced982dff1b tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:07.231280 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1f2c074a-3219-4284-bd8f-5ced982dff1b tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:07.231746 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1f2c074a-3219-4284-bd8f-5ced982dff1b tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:07.232567 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1f2c074a-3219-4284-bd8f-5ced982dff1b tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:07.233007 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1f2c074a-3219-4284-bd8f-5ced982dff1b tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:07.551537 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-48936bca-f409-433d-b8ab-24e7e01cf24a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:07.563201 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-48936bca-f409-433d-b8ab-24e7e01cf24a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14" status: 200 len: 1614 microversion: 2.1 time: 0.422557 May 03 21:33:07.574723 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 329/607] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:07 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14 => generated 1614 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:07.590161 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-5248b558-9e2e-404a-b279-9096d86e0f59 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:07.590806 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-5248b558-9e2e-404a-b279-9096d86e0f59 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:07.603928 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5248b558-9e2e-404a-b279-9096d86e0f59 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:07.603928 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5248b558-9e2e-404a-b279-9096d86e0f59 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:07.603928 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5248b558-9e2e-404a-b279-9096d86e0f59 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:07.603928 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5248b558-9e2e-404a-b279-9096d86e0f59 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:07.998835 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-5248b558-9e2e-404a-b279-9096d86e0f59 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:08.009040 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-5248b558-9e2e-404a-b279-9096d86e0f59 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1666 microversion: 2.1 time: 0.432175 May 03 21:33:08.010693 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 330/608] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:07 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1666 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:08.030871 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-1f2c074a-3219-4284-bd8f-5ced982dff1b tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6/os-volume_attachments/b45cc8cb-d92f-4ac8-9bce-4a8516c6ba72" status: 202 len: 0 microversion: 2.1 time: 0.818377 May 03 21:33:08.031671 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 279/609] 10.222.0.48 () {58 vars in 1415 bytes} [Tue May 3 21:33:07 2022] DELETE /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6/os-volume_attachments/b45cc8cb-d92f-4ac8-9bce-4a8516c6ba72 => generated 0 bytes in 820 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 21:33:08.131079 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-ba0fe4bf-848d-4ac3-bc16-02fdd6854efd tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:08.131821 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-ba0fe4bf-848d-4ac3-bc16-02fdd6854efd tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:08.176776 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ba0fe4bf-848d-4ac3-bc16-02fdd6854efd tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:08.179562 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ba0fe4bf-848d-4ac3-bc16-02fdd6854efd tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:08.181508 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ba0fe4bf-848d-4ac3-bc16-02fdd6854efd tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:08.182126 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ba0fe4bf-848d-4ac3-bc16-02fdd6854efd tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:08.229010 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-da3b5148-90d8-46f0-88bd-33c86e38f292 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:08.233567 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-da3b5148-90d8-46f0-88bd-33c86e38f292 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:08.276142 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-da3b5148-90d8-46f0-88bd-33c86e38f292 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:08.276808 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-da3b5148-90d8-46f0-88bd-33c86e38f292 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:08.281845 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-da3b5148-90d8-46f0-88bd-33c86e38f292 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:08.283284 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-da3b5148-90d8-46f0-88bd-33c86e38f292 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:08.741678 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-ba0fe4bf-848d-4ac3-bc16-02fdd6854efd tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:08.773641 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-ba0fe4bf-848d-4ac3-bc16-02fdd6854efd tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1358 microversion: 2.1 time: 0.689007 May 03 21:33:08.789983 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 331/610] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:08 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1358 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:08.814423 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-15114a23-039f-44f1-a029-239c3f5023b9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:08.819409 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-15114a23-039f-44f1-a029-239c3f5023b9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:08.837177 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-15114a23-039f-44f1-a029-239c3f5023b9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:08.838919 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-15114a23-039f-44f1-a029-239c3f5023b9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:08.840724 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-15114a23-039f-44f1-a029-239c3f5023b9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:08.843491 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-15114a23-039f-44f1-a029-239c3f5023b9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:09.026453 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-15114a23-039f-44f1-a029-239c3f5023b9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:09.038550 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-15114a23-039f-44f1-a029-239c3f5023b9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:09.038550 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.objects.instance [None req-15114a23-039f-44f1-a029-239c3f5023b9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lazy-loading 'fault' on Instance uuid 12a46337-1502-4a61-8c0d-8b5dd98d5a14 {{(pid=97832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 03 21:33:09.039093 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-da3b5148-90d8-46f0-88bd-33c86e38f292 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:09.060761 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-da3b5148-90d8-46f0-88bd-33c86e38f292 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1724 microversion: 2.1 time: 0.846718 May 03 21:33:09.070107 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 280/611] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:08 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1724 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:33:09.231790 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-15114a23-039f-44f1-a029-239c3f5023b9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:09.277026 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-15114a23-039f-44f1-a029-239c3f5023b9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14" status: 200 len: 1331 microversion: 2.1 time: 0.473760 May 03 21:33:09.280297 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 332/612] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:08 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14 => generated 1331 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:09.821901 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-f2c6a8e8-83d9-4d77-a69c-409fb3760c8e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:09.823237 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-f2c6a8e8-83d9-4d77-a69c-409fb3760c8e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:09.839987 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f2c6a8e8-83d9-4d77-a69c-409fb3760c8e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:09.843503 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f2c6a8e8-83d9-4d77-a69c-409fb3760c8e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:09.849170 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f2c6a8e8-83d9-4d77-a69c-409fb3760c8e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:09.850390 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f2c6a8e8-83d9-4d77-a69c-409fb3760c8e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:10.125584 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-7d0642da-3654-4ddd-87a0-b22bb197a35a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:10.131335 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-7d0642da-3654-4ddd-87a0-b22bb197a35a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:10.158037 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7d0642da-3654-4ddd-87a0-b22bb197a35a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:10.158037 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7d0642da-3654-4ddd-87a0-b22bb197a35a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:10.164632 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7d0642da-3654-4ddd-87a0-b22bb197a35a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:10.165138 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7d0642da-3654-4ddd-87a0-b22bb197a35a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:10.563706 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-7d0642da-3654-4ddd-87a0-b22bb197a35a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:10.582433 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-7d0642da-3654-4ddd-87a0-b22bb197a35a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1724 microversion: 2.1 time: 0.496963 May 03 21:33:10.583530 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 333/613] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:10 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1724 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:10.596959 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-3c5a533b-2b04-4a2e-bfb4-b043a9d7434e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:10.599268 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-3c5a533b-2b04-4a2e-bfb4-b043a9d7434e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:10.608754 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3c5a533b-2b04-4a2e-bfb4-b043a9d7434e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:10.609393 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3c5a533b-2b04-4a2e-bfb4-b043a9d7434e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:10.610615 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3c5a533b-2b04-4a2e-bfb4-b043a9d7434e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:10.611523 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3c5a533b-2b04-4a2e-bfb4-b043a9d7434e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:10.687545 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.wsgi [None req-3c5a533b-2b04-4a2e-bfb4-b043a9d7434e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] HTTP exception thrown: Instance 12a46337-1502-4a61-8c0d-8b5dd98d5a14 could not be found. May 03 21:33:10.688313 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-3c5a533b-2b04-4a2e-bfb4-b043a9d7434e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Returning 404 to user: Instance 12a46337-1502-4a61-8c0d-8b5dd98d5a14 could not be found. {{(pid=97832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:33:10.689490 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-3c5a533b-2b04-4a2e-bfb4-b043a9d7434e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14" status: 404 len: 111 microversion: 2.1 time: 0.104731 May 03 21:33:10.690174 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 334/614] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:10 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 21:33:10.702075 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-13054524-74bf-4a4a-a1c1-1d42221e7522 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:10.703155 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-13054524-74bf-4a4a-a1c1-1d42221e7522 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:10.718924 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-13054524-74bf-4a4a-a1c1-1d42221e7522 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:10.719736 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-13054524-74bf-4a4a-a1c1-1d42221e7522 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:10.720925 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-13054524-74bf-4a4a-a1c1-1d42221e7522 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:10.721690 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-13054524-74bf-4a4a-a1c1-1d42221e7522 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:10.875189 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-13054524-74bf-4a4a-a1c1-1d42221e7522 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6] Going to try to terminate instance {{(pid=97832) delete /opt/stack/nova/nova/compute/api.py:2559}} May 03 21:33:11.494225 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-f2c6a8e8-83d9-4d77-a69c-409fb3760c8e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:11.506356 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-f2c6a8e8-83d9-4d77-a69c-409fb3760c8e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1358 microversion: 2.1 time: 1.713642 May 03 21:33:11.507244 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 281/615] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:09 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1358 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:11.527295 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-2e00d25a-6b85-4d57-a80f-d0b96b5eb097 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '.version_select at 0x7fc84cc20820>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:11.625711 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-2e00d25a-6b85-4d57-a80f-d0b96b5eb097 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1034276759" status: 202 len: 0 microversion: 2.1 time: 0.116863 May 03 21:33:11.626947 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 282/616] 10.222.0.48 () {58 vars in 1220 bytes} [Tue May 3 21:33:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1034276759 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 21:33:11.646652 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-fb1ce665-b759-4138-9371-85b140646a91 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:11.660393 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-fb1ce665-b759-4138-9371-85b140646a91 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:11.765549 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-13054524-74bf-4a4a-a1c1-1d42221e7522 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6" status: 204 len: 0 microversion: 2.1 time: 1.073551 May 03 21:33:11.769357 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 335/617] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 3 21:33:10 2022] DELETE /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6 => generated 0 bytes in 1076 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 03 21:33:11.789542 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-ea7e9719-2084-4163-9e37-8bf08f87a20e req-3b6a1b15-e331-464f-b0ef-f9b9690fe937 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f13ba9d5-9344-4748-8e24-118858bfce42", "tag": "85f0f545-6b51-41b2-a9ee-a8c17abc2f57"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:33:11.803056 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:33:11.803056 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:33:11.839182 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-ea7e9719-2084-4163-9e37-8bf08f87a20e req-3b6a1b15-e331-464f-b0ef-f9b9690fe937 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:11.839630 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-ea7e9719-2084-4163-9e37-8bf08f87a20e req-3b6a1b15-e331-464f-b0ef-f9b9690fe937 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:11.884130 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-ea7e9719-2084-4163-9e37-8bf08f87a20e req-3b6a1b15-e331-464f-b0ef-f9b9690fe937 service nova] Creating event network-changed:85f0f545-6b51-41b2-a9ee-a8c17abc2f57 for instance f13ba9d5-9344-4748-8e24-118858bfce42 on hv-cinder-84037 May 03 21:33:11.901820 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fb1ce665-b759-4138-9371-85b140646a91 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:11.908032 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-ea7e9719-2084-4163-9e37-8bf08f87a20e req-3b6a1b15-e331-464f-b0ef-f9b9690fe937 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138703 May 03 21:33:11.916106 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fb1ce665-b759-4138-9371-85b140646a91 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:11.916805 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 336/618] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:33:11.917843 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fb1ce665-b759-4138-9371-85b140646a91 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:11.918306 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fb1ce665-b759-4138-9371-85b140646a91 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:11.948523 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-a8d654a6-0408-46db-a94c-69094a0be297 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:11.950375 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-a8d654a6-0408-46db-a94c-69094a0be297 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:11.967315 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a8d654a6-0408-46db-a94c-69094a0be297 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:11.970466 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a8d654a6-0408-46db-a94c-69094a0be297 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:11.970466 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a8d654a6-0408-46db-a94c-69094a0be297 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:11.971417 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a8d654a6-0408-46db-a94c-69094a0be297 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:12.500167 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-a8d654a6-0408-46db-a94c-69094a0be297 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:12.512984 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-a8d654a6-0408-46db-a94c-69094a0be297 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6" status: 200 len: 1513 microversion: 2.1 time: 0.584018 May 03 21:33:12.513833 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 337/619] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:11 2022] GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6 => generated 1513 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:12.540288 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-9a6a6bab-7839-4dae-b7d4-ee6b78da249f tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:12.543788 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-9a6a6bab-7839-4dae-b7d4-ee6b78da249f tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:12.560880 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9a6a6bab-7839-4dae-b7d4-ee6b78da249f tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:12.563860 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9a6a6bab-7839-4dae-b7d4-ee6b78da249f tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:12.569702 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9a6a6bab-7839-4dae-b7d4-ee6b78da249f tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:12.570566 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9a6a6bab-7839-4dae-b7d4-ee6b78da249f tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:12.586691 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-fb1ce665-b759-4138-9371-85b140646a91 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:12.610331 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-fb1ce665-b759-4138-9371-85b140646a91 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1724 microversion: 2.1 time: 0.981667 May 03 21:33:12.612604 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 283/620] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:11 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1724 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:13.142771 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-9a6a6bab-7839-4dae-b7d4-ee6b78da249f tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:13.156307 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-9a6a6bab-7839-4dae-b7d4-ee6b78da249f tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1358 microversion: 2.1 time: 0.636549 May 03 21:33:13.157249 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 338/621] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:12 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1358 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:33:13.538051 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-7b66a83c-6c16-4762-b830-6693ccbd9718 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:13.538655 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-7b66a83c-6c16-4762-b830-6693ccbd9718 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:13.549438 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7b66a83c-6c16-4762-b830-6693ccbd9718 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:13.549986 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7b66a83c-6c16-4762-b830-6693ccbd9718 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:13.551461 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7b66a83c-6c16-4762-b830-6693ccbd9718 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:13.552082 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7b66a83c-6c16-4762-b830-6693ccbd9718 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:13.642580 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-59d366e1-ab58-4790-92de-af58a3150fa9 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:13.643191 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-59d366e1-ab58-4790-92de-af58a3150fa9 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:13.653005 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-59d366e1-ab58-4790-92de-af58a3150fa9 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:13.653447 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-59d366e1-ab58-4790-92de-af58a3150fa9 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:13.654343 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-59d366e1-ab58-4790-92de-af58a3150fa9 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:13.654826 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-59d366e1-ab58-4790-92de-af58a3150fa9 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:14.161371 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-59d366e1-ab58-4790-92de-af58a3150fa9 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:14.188155 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-59d366e1-ab58-4790-92de-af58a3150fa9 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1724 microversion: 2.1 time: 0.555661 May 03 21:33:14.198857 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 339/622] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:13 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1724 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:14.221251 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-95faa5e9-3647-4663-b863-8f20192a1e4c tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:14.224999 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-95faa5e9-3647-4663-b863-8f20192a1e4c tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:14.258237 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-95faa5e9-3647-4663-b863-8f20192a1e4c tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:14.259491 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-95faa5e9-3647-4663-b863-8f20192a1e4c tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:14.260484 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-95faa5e9-3647-4663-b863-8f20192a1e4c tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:14.261815 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-95faa5e9-3647-4663-b863-8f20192a1e4c tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:14.333786 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-7b66a83c-6c16-4762-b830-6693ccbd9718 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:14.358457 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-7b66a83c-6c16-4762-b830-6693ccbd9718 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6" status: 200 len: 1513 microversion: 2.1 time: 0.829949 May 03 21:33:14.369344 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 284/623] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:13 2022] GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6 => generated 1513 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:14.433507 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-d142d2ad-5c41-437c-b198-33fd6325fe9b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Action: 'create', calling method: .version_select at 0x7fc84ca58700>, body: {"keypair": {"name": "tempest-keypair-1237756290"}} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:33:14.469745 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-d142d2ad-5c41-437c-b198-33fd6325fe9b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Getting quotas for project bd571e41b44a4bc6b16bf8163252f168. Resources: {'key_pairs'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:33:14.476836 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-d142d2ad-5c41-437c-b198-33fd6325fe9b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Getting quotas for user c2fe2da4d72e4522ac8bbb7c9a58381a and project bd571e41b44a4bc6b16bf8163252f168. Resources: {'key_pairs'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:33:14.621437 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-95faa5e9-3647-4663-b863-8f20192a1e4c tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:14.643010 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-95faa5e9-3647-4663-b863-8f20192a1e4c tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1358 microversion: 2.1 time: 0.452466 May 03 21:33:14.654506 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 340/624] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:14 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1358 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:15.012514 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-d142d2ad-5c41-437c-b198-33fd6325fe9b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Getting quotas for project bd571e41b44a4bc6b16bf8163252f168. Resources: {'key_pairs'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:33:15.016777 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-d142d2ad-5c41-437c-b198-33fd6325fe9b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Getting quotas for user c2fe2da4d72e4522ac8bbb7c9a58381a and project bd571e41b44a4bc6b16bf8163252f168. Resources: {'key_pairs'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:33:15.037600 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-d142d2ad-5c41-437c-b198-33fd6325fe9b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.614576 May 03 21:33:15.046212 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 285/625] 10.222.0.48 () {60 vars in 1157 bytes} [Tue May 3 21:33:14 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:33:15.218415 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-b6ba0ed3-56c3-44d5-892d-475f3e3c1ea0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:15.222839 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-b6ba0ed3-56c3-44d5-892d-475f3e3c1ea0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:15.235357 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b6ba0ed3-56c3-44d5-892d-475f3e3c1ea0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:15.236618 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b6ba0ed3-56c3-44d5-892d-475f3e3c1ea0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:15.239183 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b6ba0ed3-56c3-44d5-892d-475f3e3c1ea0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:15.239855 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b6ba0ed3-56c3-44d5-892d-475f3e3c1ea0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:15.391871 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-147450a4-9d2b-4b7b-b0fa-41acfd5e58b8 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:15.392515 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-147450a4-9d2b-4b7b-b0fa-41acfd5e58b8 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:15.401779 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-147450a4-9d2b-4b7b-b0fa-41acfd5e58b8 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:15.402738 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-147450a4-9d2b-4b7b-b0fa-41acfd5e58b8 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:15.403171 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-147450a4-9d2b-4b7b-b0fa-41acfd5e58b8 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:15.403439 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-147450a4-9d2b-4b7b-b0fa-41acfd5e58b8 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:15.507012 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-b6ba0ed3-56c3-44d5-892d-475f3e3c1ea0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:15.530816 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-b6ba0ed3-56c3-44d5-892d-475f3e3c1ea0 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1724 microversion: 2.1 time: 0.327742 May 03 21:33:15.546713 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 341/626] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:15 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1724 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:15.670746 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-0f7e845b-86bc-4aa7-a731-6eda4e8359f9 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:15.671604 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-0f7e845b-86bc-4aa7-a731-6eda4e8359f9 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:15.681253 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0f7e845b-86bc-4aa7-a731-6eda4e8359f9 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:15.681825 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0f7e845b-86bc-4aa7-a731-6eda4e8359f9 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:15.682926 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0f7e845b-86bc-4aa7-a731-6eda4e8359f9 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:15.683535 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0f7e845b-86bc-4aa7-a731-6eda4e8359f9 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:15.702749 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-147450a4-9d2b-4b7b-b0fa-41acfd5e58b8 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:15.713929 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-147450a4-9d2b-4b7b-b0fa-41acfd5e58b8 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6" status: 200 len: 1513 microversion: 2.1 time: 0.331163 May 03 21:33:15.724402 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 286/627] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:15 2022] GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6 => generated 1513 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:33:16.036852 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-0f7e845b-86bc-4aa7-a731-6eda4e8359f9 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:16.036852 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-0f7e845b-86bc-4aa7-a731-6eda4e8359f9 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1358 microversion: 2.1 time: 0.371118 May 03 21:33:16.056858 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 342/628] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:15 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1358 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:16.561886 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-f3c815a0-b3cd-488e-9af3-bd7accc373d7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:16.563720 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-f3c815a0-b3cd-488e-9af3-bd7accc373d7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:16.572348 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f3c815a0-b3cd-488e-9af3-bd7accc373d7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:16.573283 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f3c815a0-b3cd-488e-9af3-bd7accc373d7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:16.574335 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f3c815a0-b3cd-488e-9af3-bd7accc373d7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:16.574881 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f3c815a0-b3cd-488e-9af3-bd7accc373d7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:16.758959 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-95df9135-bb20-46e1-a536-00d73a79185e tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:16.761746 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-95df9135-bb20-46e1-a536-00d73a79185e tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:16.785995 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-95df9135-bb20-46e1-a536-00d73a79185e tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:16.788390 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-95df9135-bb20-46e1-a536-00d73a79185e tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:16.790240 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-95df9135-bb20-46e1-a536-00d73a79185e tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:16.790684 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-95df9135-bb20-46e1-a536-00d73a79185e tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:16.964684 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-f3c815a0-b3cd-488e-9af3-bd7accc373d7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:16.984270 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-f3c815a0-b3cd-488e-9af3-bd7accc373d7 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1724 microversion: 2.1 time: 0.434570 May 03 21:33:16.985601 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 287/629] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:16 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1724 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:17.064343 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-c5264bd5-5dd6-44e8-b101-369bf57341c1 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:17.064973 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-c5264bd5-5dd6-44e8-b101-369bf57341c1 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:17.073186 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c5264bd5-5dd6-44e8-b101-369bf57341c1 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:17.073637 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c5264bd5-5dd6-44e8-b101-369bf57341c1 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:17.074419 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c5264bd5-5dd6-44e8-b101-369bf57341c1 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:17.074872 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c5264bd5-5dd6-44e8-b101-369bf57341c1 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:17.112587 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-95df9135-bb20-46e1-a536-00d73a79185e tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:17.121331 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-95df9135-bb20-46e1-a536-00d73a79185e tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6" status: 200 len: 1513 microversion: 2.1 time: 0.393417 May 03 21:33:17.122336 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 343/630] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:16 2022] GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6 => generated 1513 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:33:17.340085 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-c5264bd5-5dd6-44e8-b101-369bf57341c1 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:17.349468 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-c5264bd5-5dd6-44e8-b101-369bf57341c1 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1358 microversion: 2.1 time: 0.294035 May 03 21:33:17.350058 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 288/631] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:17 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1358 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:33:18.013462 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-4aea24e0-9b64-44f3-b991-c3305551784d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:18.014056 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-4aea24e0-9b64-44f3-b991-c3305551784d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:18.027335 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4aea24e0-9b64-44f3-b991-c3305551784d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:18.028088 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4aea24e0-9b64-44f3-b991-c3305551784d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:18.029644 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4aea24e0-9b64-44f3-b991-c3305551784d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:18.030411 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4aea24e0-9b64-44f3-b991-c3305551784d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:18.162435 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-a6a56394-0e06-4a48-839c-0f83eee5b492 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:18.163463 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-a6a56394-0e06-4a48-839c-0f83eee5b492 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:18.171817 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a6a56394-0e06-4a48-839c-0f83eee5b492 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:18.172347 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a6a56394-0e06-4a48-839c-0f83eee5b492 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:18.173420 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a6a56394-0e06-4a48-839c-0f83eee5b492 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:18.173926 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a6a56394-0e06-4a48-839c-0f83eee5b492 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:18.349404 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-4aea24e0-9b64-44f3-b991-c3305551784d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:18.358513 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-4aea24e0-9b64-44f3-b991-c3305551784d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1724 microversion: 2.1 time: 0.354353 May 03 21:33:18.359070 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 344/632] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:18 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1724 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:18.391010 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-9db5fde4-fc69-47ec-b95e-3ec6db0ee13e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:18.392064 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-9db5fde4-fc69-47ec-b95e-3ec6db0ee13e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:18.400992 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9db5fde4-fc69-47ec-b95e-3ec6db0ee13e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:18.401782 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9db5fde4-fc69-47ec-b95e-3ec6db0ee13e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:18.403384 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9db5fde4-fc69-47ec-b95e-3ec6db0ee13e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:18.403384 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9db5fde4-fc69-47ec-b95e-3ec6db0ee13e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:18.423387 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-a6a56394-0e06-4a48-839c-0f83eee5b492 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:18.433875 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-a6a56394-0e06-4a48-839c-0f83eee5b492 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6" status: 200 len: 1513 microversion: 2.1 time: 0.296356 May 03 21:33:18.434759 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 289/633] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:18 2022] GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6 => generated 1513 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:18.788722 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-9db5fde4-fc69-47ec-b95e-3ec6db0ee13e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:18.803623 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-9db5fde4-fc69-47ec-b95e-3ec6db0ee13e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1358 microversion: 2.1 time: 0.428964 May 03 21:33:18.812929 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 345/634] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:18 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1358 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:19.391249 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-d8a4bbf5-b5c2-44d4-8edb-a33f8c0db2e5 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:19.392070 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-d8a4bbf5-b5c2-44d4-8edb-a33f8c0db2e5 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:19.401233 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d8a4bbf5-b5c2-44d4-8edb-a33f8c0db2e5 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:19.401683 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d8a4bbf5-b5c2-44d4-8edb-a33f8c0db2e5 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:19.402462 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d8a4bbf5-b5c2-44d4-8edb-a33f8c0db2e5 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:19.403082 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d8a4bbf5-b5c2-44d4-8edb-a33f8c0db2e5 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:19.466140 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-49f56f57-6696-46cd-833a-66859c92ae08 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:19.467518 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-49f56f57-6696-46cd-833a-66859c92ae08 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:19.476750 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-49f56f57-6696-46cd-833a-66859c92ae08 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:19.477637 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-49f56f57-6696-46cd-833a-66859c92ae08 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:19.478691 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-49f56f57-6696-46cd-833a-66859c92ae08 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:19.479331 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-49f56f57-6696-46cd-833a-66859c92ae08 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:19.747654 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-49f56f57-6696-46cd-833a-66859c92ae08 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:19.760960 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-49f56f57-6696-46cd-833a-66859c92ae08 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6" status: 200 len: 1513 microversion: 2.1 time: 0.307072 May 03 21:33:19.761826 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 346/635] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:19 2022] GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6 => generated 1513 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:19.774143 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-be459578-e0f4-4afc-b651-b5f741d5e3ec tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1228711520", "imageRef": "f5214328-64f1-4aa6-aa05-61f0189e0e1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "afa29ce3-7ea1-4fb3-8d15-b28913382476"}], "security_groups": [{"name": "tempest-securitygroup--480980785"}], "key_name": "tempest-keypair-1237756290", "user_data": "}} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:33:19.981766 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.network.neutron [None req-be459578-e0f4-4afc-b651-b5f741d5e3ec tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] validate_networks() for [('afa29ce3-7ea1-4fb3-8d15-b28913382476', None, None, None)] {{(pid=97832) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} May 03 21:33:20.157088 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-d8a4bbf5-b5c2-44d4-8edb-a33f8c0db2e5 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:20.170545 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-d8a4bbf5-b5c2-44d4-8edb-a33f8c0db2e5 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1730 microversion: 2.1 time: 0.787932 May 03 21:33:20.170545 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 290/636] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:19 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1730 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:20.182065 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-10c4e8c7-9375-49d3-a642-bd58930b5b74 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:20.183263 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-10c4e8c7-9375-49d3-a642-bd58930b5b74 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:20.192259 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-10c4e8c7-9375-49d3-a642-bd58930b5b74 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:20.193013 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-10c4e8c7-9375-49d3-a642-bd58930b5b74 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:20.193960 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-10c4e8c7-9375-49d3-a642-bd58930b5b74 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:20.194562 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-10c4e8c7-9375-49d3-a642-bd58930b5b74 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:20.445633 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-10c4e8c7-9375-49d3-a642-bd58930b5b74 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:20.466715 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-10c4e8c7-9375-49d3-a642-bd58930b5b74 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1358 microversion: 2.1 time: 0.285845 May 03 21:33:20.467518 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 291/637] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:20 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1358 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:20.479297 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-2dd51530-f859-46eb-a749-362e1e314769 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:20.479796 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-2dd51530-f859-46eb-a749-362e1e314769 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:20.496616 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2dd51530-f859-46eb-a749-362e1e314769 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:20.512320 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2dd51530-f859-46eb-a749-362e1e314769 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:20.512320 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2dd51530-f859-46eb-a749-362e1e314769 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:20.512320 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2dd51530-f859-46eb-a749-362e1e314769 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:20.642523 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-be459578-e0f4-4afc-b651-b5f741d5e3ec tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Flavor limits 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} May 03 21:33:20.643052 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-be459578-e0f4-4afc-b651-b5f741d5e3ec tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Image limits 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} May 03 21:33:20.643394 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-be459578-e0f4-4afc-b651-b5f741d5e3ec tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Flavor pref 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} May 03 21:33:20.643856 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-be459578-e0f4-4afc-b651-b5f741d5e3ec tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Image pref 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} May 03 21:33:20.644785 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-be459578-e0f4-4afc-b651-b5f741d5e3ec tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} May 03 21:33:20.653946 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-be459578-e0f4-4afc-b651-b5f741d5e3ec tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:20.655691 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-be459578-e0f4-4afc-b651-b5f741d5e3ec tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:20.655691 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-be459578-e0f4-4afc-b651-b5f741d5e3ec tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:20.655691 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-be459578-e0f4-4afc-b651-b5f741d5e3ec tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:20.682016 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-be459578-e0f4-4afc-b651-b5f741d5e3ec tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Getting quotas for project bd571e41b44a4bc6b16bf8163252f168. Resources: {'instances', 'ram', 'cores'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:33:20.686528 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-be459578-e0f4-4afc-b651-b5f741d5e3ec tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Getting quotas for user c2fe2da4d72e4522ac8bbb7c9a58381a and project bd571e41b44a4bc6b16bf8163252f168. Resources: {'instances', 'ram', 'cores'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:33:20.700053 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-be459578-e0f4-4afc-b651-b5f741d5e3ec tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Going to run 1 instances... {{(pid=97832) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} May 03 21:33:20.702961 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-be459578-e0f4-4afc-b651-b5f741d5e3ec tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 1233302d-c8af-43d2-9b77-4394d2674961] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5214328-64f1-4aa6-aa05-61f0189e0e1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=97832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} May 03 21:33:20.738450 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-2dd51530-f859-46eb-a749-362e1e314769 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.269063 May 03 21:33:20.739063 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 292/638] 10.222.0.48 () {58 vars in 1274 bytes} [Tue May 3 21:33:20 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52/os-interface => generated 285 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:33:20.750219 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-a658166e-10d7-4203-96c2-a37aa6b21c4d req-f2241463-dae6-4886-8694-01507f9e20b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7faa75bc-a237-4850-b9c4-fcd56ac7b0b6", "name": "network-vif-deleted", "tag": "3d939f88-ef7f-49d3-beb5-514a56fdf884"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:33:20.758481 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:33:20.758481 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:33:20.768270 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-a658166e-10d7-4203-96c2-a37aa6b21c4d req-f2241463-dae6-4886-8694-01507f9e20b5 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:20.769458 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-a658166e-10d7-4203-96c2-a37aa6b21c4d req-f2241463-dae6-4886-8694-01507f9e20b5 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:20.787520 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-a658166e-10d7-4203-96c2-a37aa6b21c4d req-f2241463-dae6-4886-8694-01507f9e20b5 service nova] Creating event network-vif-deleted:3d939f88-ef7f-49d3-beb5-514a56fdf884 for instance 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6 on hv-cinder-84037 May 03 21:33:20.792554 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-a658166e-10d7-4203-96c2-a37aa6b21c4d req-f2241463-dae6-4886-8694-01507f9e20b5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052291 May 03 21:33:20.793172 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 293/639] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:33:20.807410 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-96702b0b-43d7-428e-8685-61572c1f4ab3 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:20.808639 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-96702b0b-43d7-428e-8685-61572c1f4ab3 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:20.817570 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-96702b0b-43d7-428e-8685-61572c1f4ab3 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:20.818338 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-96702b0b-43d7-428e-8685-61572c1f4ab3 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:20.819402 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-96702b0b-43d7-428e-8685-61572c1f4ab3 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:20.820105 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-96702b0b-43d7-428e-8685-61572c1f4ab3 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:20.879927 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-be459578-e0f4-4afc-b651-b5f741d5e3ec tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.116068 May 03 21:33:20.885093 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 347/640] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 3 21:33:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 1123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 03 21:33:20.910850 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-8df281b6-ec53-4af0-942f-7ff1867f7c18 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:20.912579 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-8df281b6-ec53-4af0-942f-7ff1867f7c18 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 1233302d-c8af-43d2-9b77-4394d2674961] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:21.017708 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-8df281b6-ec53-4af0-942f-7ff1867f7c18 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:21.024021 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-8df281b6-ec53-4af0-942f-7ff1867f7c18 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961" status: 200 len: 1242 microversion: 2.1 time: 0.129018 May 03 21:33:21.025427 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 348/641] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:20 2022] GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961 => generated 1242 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:33:21.480873 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-a86ea89b-dc33-4840-a37c-e83f4f55b05e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:21.481487 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-a86ea89b-dc33-4840-a37c-e83f4f55b05e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:21.489572 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a86ea89b-dc33-4840-a37c-e83f4f55b05e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:21.490024 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a86ea89b-dc33-4840-a37c-e83f4f55b05e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:21.490807 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a86ea89b-dc33-4840-a37c-e83f4f55b05e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:21.491243 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a86ea89b-dc33-4840-a37c-e83f4f55b05e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:21.702647 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-a86ea89b-dc33-4840-a37c-e83f4f55b05e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:21.711471 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-a86ea89b-dc33-4840-a37c-e83f4f55b05e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1358 microversion: 2.1 time: 0.240362 May 03 21:33:21.712028 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 349/642] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:21 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:33:21.744141 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-96702b0b-43d7-428e-8685-61572c1f4ab3 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237395ade5344a7eba25fdd620c165f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103e27d9374d41689ceff14ee5a5ae21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:21.752635 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-96702b0b-43d7-428e-8685-61572c1f4ab3 tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6" status: 200 len: 1471 microversion: 2.1 time: 0.958033 May 03 21:33:21.753166 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 294/643] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:20 2022] GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6 => generated 1471 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:22.051688 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-7baaa7c0-1d99-44cb-b2ed-1d20463e9249 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:22.052361 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-7baaa7c0-1d99-44cb-b2ed-1d20463e9249 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 1233302d-c8af-43d2-9b77-4394d2674961] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:22.173930 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-7baaa7c0-1d99-44cb-b2ed-1d20463e9249 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:22.184302 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-7baaa7c0-1d99-44cb-b2ed-1d20463e9249 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961" status: 200 len: 1242 microversion: 2.1 time: 0.142573 May 03 21:33:22.185557 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 350/644] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:22 2022] GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961 => generated 1242 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:33:22.740745 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-c0f41c2a-33eb-4723-8f58-595019fa705a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:22.741788 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-c0f41c2a-33eb-4723-8f58-595019fa705a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:22.754445 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c0f41c2a-33eb-4723-8f58-595019fa705a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:22.755416 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c0f41c2a-33eb-4723-8f58-595019fa705a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:22.755841 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c0f41c2a-33eb-4723-8f58-595019fa705a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:22.756266 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c0f41c2a-33eb-4723-8f58-595019fa705a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:22.777664 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-5adc5882-66cd-45b6-8e04-118ca3305b0a tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:22.779057 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-5adc5882-66cd-45b6-8e04-118ca3305b0a tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] [instance: 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:22.787696 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5adc5882-66cd-45b6-8e04-118ca3305b0a tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:22.788549 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5adc5882-66cd-45b6-8e04-118ca3305b0a tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:22.789454 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5adc5882-66cd-45b6-8e04-118ca3305b0a tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:22.790100 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5adc5882-66cd-45b6-8e04-118ca3305b0a tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:22.852748 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.wsgi [None req-5adc5882-66cd-45b6-8e04-118ca3305b0a tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] HTTP exception thrown: Instance 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6 could not be found. May 03 21:33:22.853503 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-5adc5882-66cd-45b6-8e04-118ca3305b0a tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] Returning 404 to user: Instance 7faa75bc-a237-4850-b9c4-fcd56ac7b0b6 could not be found. {{(pid=97832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:33:22.855173 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-5adc5882-66cd-45b6-8e04-118ca3305b0a tempest-VolumesSnapshotTestJSON-1309513029 tempest-VolumesSnapshotTestJSON-1309513029-project] 10.222.0.48 "GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6" status: 404 len: 111 microversion: 2.1 time: 0.087920 May 03 21:33:22.856357 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 351/645] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:22 2022] GET /compute/v2.1/servers/7faa75bc-a237-4850-b9c4-fcd56ac7b0b6 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 21:33:23.168478 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-7d8d20c8-a0e2-49b8-8db1-2eb29cda1765 req-8056430f-a645-4144-bad1-9bcebae42080 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb2b9b5d-640a-401a-ac60-566b6d8dbc52", "tag": "a2903b13-fffc-4e5f-9a12-4bcb585327dd"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:33:23.201786 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:33:23.201786 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:33:23.222035 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-7d8d20c8-a0e2-49b8-8db1-2eb29cda1765 req-8056430f-a645-4144-bad1-9bcebae42080 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:23.227115 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-7d8d20c8-a0e2-49b8-8db1-2eb29cda1765 req-8056430f-a645-4144-bad1-9bcebae42080 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:23.247470 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-7d8d20c8-a0e2-49b8-8db1-2eb29cda1765 req-8056430f-a645-4144-bad1-9bcebae42080 service nova] Creating event network-changed:a2903b13-fffc-4e5f-9a12-4bcb585327dd for instance cb2b9b5d-640a-401a-ac60-566b6d8dbc52 on hv-cinder-84037 May 03 21:33:23.252981 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-7d8d20c8-a0e2-49b8-8db1-2eb29cda1765 req-8056430f-a645-4144-bad1-9bcebae42080 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094692 May 03 21:33:23.254533 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 352/646] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:33:23.267203 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-a0ecbf32-327a-42fe-9db7-0b6b3fb7e692 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:23.268165 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-a0ecbf32-327a-42fe-9db7-0b6b3fb7e692 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 1233302d-c8af-43d2-9b77-4394d2674961] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:23.279230 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a0ecbf32-327a-42fe-9db7-0b6b3fb7e692 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:23.279852 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a0ecbf32-327a-42fe-9db7-0b6b3fb7e692 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:23.280838 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a0ecbf32-327a-42fe-9db7-0b6b3fb7e692 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:23.281461 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a0ecbf32-327a-42fe-9db7-0b6b3fb7e692 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:23.454941 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-a0ecbf32-327a-42fe-9db7-0b6b3fb7e692 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:23.483341 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-c0f41c2a-33eb-4723-8f58-595019fa705a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:23.484157 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-a0ecbf32-327a-42fe-9db7-0b6b3fb7e692 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961" status: 200 len: 1238 microversion: 2.1 time: 0.227574 May 03 21:33:23.491894 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 353/647] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:23 2022] GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961 => generated 1238 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:23.516773 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-c0f41c2a-33eb-4723-8f58-595019fa705a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1358 microversion: 2.1 time: 0.790728 May 03 21:33:23.524685 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 295/648] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:22 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1358 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:24.513774 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-9c0a6a7d-a266-45e4-8aaf-2121cde8195f tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:24.519445 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-9c0a6a7d-a266-45e4-8aaf-2121cde8195f tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 1233302d-c8af-43d2-9b77-4394d2674961] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:24.522699 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9c0a6a7d-a266-45e4-8aaf-2121cde8195f tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:24.523156 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9c0a6a7d-a266-45e4-8aaf-2121cde8195f tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:24.523958 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9c0a6a7d-a266-45e4-8aaf-2121cde8195f tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:24.524611 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9c0a6a7d-a266-45e4-8aaf-2121cde8195f tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:24.540704 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-c97bc0fd-fe17-42dd-a381-6a027a877afd tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:24.541320 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-c97bc0fd-fe17-42dd-a381-6a027a877afd tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:24.550636 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c97bc0fd-fe17-42dd-a381-6a027a877afd tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:24.551781 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c97bc0fd-fe17-42dd-a381-6a027a877afd tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:24.556941 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c97bc0fd-fe17-42dd-a381-6a027a877afd tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:24.556941 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c97bc0fd-fe17-42dd-a381-6a027a877afd tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:24.726169 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-9c0a6a7d-a266-45e4-8aaf-2121cde8195f tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:24.736468 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-9c0a6a7d-a266-45e4-8aaf-2121cde8195f tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961" status: 200 len: 1302 microversion: 2.1 time: 0.233996 May 03 21:33:24.737881 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 354/649] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:24 2022] GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961 => generated 1302 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:25.282412 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-3fe23e06-b431-4e99-94df-d9a1508ab034 req-82d046f2-1c73-4894-a4bb-9b99009344c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb2b9b5d-640a-401a-ac60-566b6d8dbc52", "tag": "a2903b13-fffc-4e5f-9a12-4bcb585327dd"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:33:25.291184 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:33:25.291184 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:33:25.300656 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-3fe23e06-b431-4e99-94df-d9a1508ab034 req-82d046f2-1c73-4894-a4bb-9b99009344c3 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:25.301310 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-3fe23e06-b431-4e99-94df-d9a1508ab034 req-82d046f2-1c73-4894-a4bb-9b99009344c3 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:25.320278 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-3fe23e06-b431-4e99-94df-d9a1508ab034 req-82d046f2-1c73-4894-a4bb-9b99009344c3 service nova] Creating event network-changed:a2903b13-fffc-4e5f-9a12-4bcb585327dd for instance cb2b9b5d-640a-401a-ac60-566b6d8dbc52 on hv-cinder-84037 May 03 21:33:25.325519 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-3fe23e06-b431-4e99-94df-d9a1508ab034 req-82d046f2-1c73-4894-a4bb-9b99009344c3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055015 May 03 21:33:25.326398 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 355/650] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:33:25.408591 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-c97bc0fd-fe17-42dd-a381-6a027a877afd tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:25.419194 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-c97bc0fd-fe17-42dd-a381-6a027a877afd tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1358 microversion: 2.1 time: 0.888961 May 03 21:33:25.419853 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 296/651] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:24 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1358 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:33:25.573317 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-8f43be85-7f23-452f-80a0-ae0962838749 req-370ccedb-4aba-4e7b-9cb7-c64f7080d42e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f13ba9d5-9344-4748-8e24-118858bfce42", "name": "network-vif-plugged", "status": "completed", "tag": "85f0f545-6b51-41b2-a9ee-a8c17abc2f57"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:33:25.579474 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:33:25.579474 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:33:25.588088 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-8f43be85-7f23-452f-80a0-ae0962838749 req-370ccedb-4aba-4e7b-9cb7-c64f7080d42e service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:25.588561 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-8f43be85-7f23-452f-80a0-ae0962838749 req-370ccedb-4aba-4e7b-9cb7-c64f7080d42e service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:25.606131 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-8f43be85-7f23-452f-80a0-ae0962838749 req-370ccedb-4aba-4e7b-9cb7-c64f7080d42e service nova] Creating event network-vif-plugged:85f0f545-6b51-41b2-a9ee-a8c17abc2f57 for instance f13ba9d5-9344-4748-8e24-118858bfce42 on hv-cinder-84037 May 03 21:33:25.614377 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-8f43be85-7f23-452f-80a0-ae0962838749 req-370ccedb-4aba-4e7b-9cb7-c64f7080d42e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048276 May 03 21:33:25.614377 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 356/652] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:33:25.771646 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-914ecbcb-f925-420a-9d4d-9a068944ea6b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:25.772579 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-914ecbcb-f925-420a-9d4d-9a068944ea6b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 1233302d-c8af-43d2-9b77-4394d2674961] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:25.780893 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-914ecbcb-f925-420a-9d4d-9a068944ea6b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:25.781689 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-914ecbcb-f925-420a-9d4d-9a068944ea6b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:25.782931 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-914ecbcb-f925-420a-9d4d-9a068944ea6b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:25.783491 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-914ecbcb-f925-420a-9d4d-9a068944ea6b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:26.137477 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-914ecbcb-f925-420a-9d4d-9a068944ea6b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:26.146348 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-914ecbcb-f925-420a-9d4d-9a068944ea6b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961" status: 200 len: 1300 microversion: 2.1 time: 0.390208 May 03 21:33:26.146894 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 297/653] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:25 2022] GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961 => generated 1300 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:26.443879 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-d8f85dc2-a26f-4d71-b32d-2de6d2869e03 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:26.445633 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-d8f85dc2-a26f-4d71-b32d-2de6d2869e03 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:26.457167 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d8f85dc2-a26f-4d71-b32d-2de6d2869e03 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:26.457863 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d8f85dc2-a26f-4d71-b32d-2de6d2869e03 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:26.458406 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d8f85dc2-a26f-4d71-b32d-2de6d2869e03 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:26.458846 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d8f85dc2-a26f-4d71-b32d-2de6d2869e03 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:26.678028 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-d8f85dc2-a26f-4d71-b32d-2de6d2869e03 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:26.686656 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-d8f85dc2-a26f-4d71-b32d-2de6d2869e03 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1358 microversion: 2.1 time: 0.253478 May 03 21:33:26.687396 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 357/654] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:26 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1358 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:27.168648 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-2c1aa2b7-bd49-4d98-ad7c-3bb6022961c8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:27.169263 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-2c1aa2b7-bd49-4d98-ad7c-3bb6022961c8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 1233302d-c8af-43d2-9b77-4394d2674961] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:27.176748 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2c1aa2b7-bd49-4d98-ad7c-3bb6022961c8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:27.177200 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2c1aa2b7-bd49-4d98-ad7c-3bb6022961c8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:27.177976 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2c1aa2b7-bd49-4d98-ad7c-3bb6022961c8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:27.178411 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2c1aa2b7-bd49-4d98-ad7c-3bb6022961c8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:27.402019 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-2c1aa2b7-bd49-4d98-ad7c-3bb6022961c8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:27.411397 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-2c1aa2b7-bd49-4d98-ad7c-3bb6022961c8 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961" status: 200 len: 1367 microversion: 2.1 time: 0.252452 May 03 21:33:27.411921 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 298/655] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:27 2022] GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961 => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:27.710394 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-f5cc7a44-9e3e-4c46-be43-c92e319e000b tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:27.711005 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-f5cc7a44-9e3e-4c46-be43-c92e319e000b tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:27.718366 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f5cc7a44-9e3e-4c46-be43-c92e319e000b tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:27.718804 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f5cc7a44-9e3e-4c46-be43-c92e319e000b tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:27.719565 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f5cc7a44-9e3e-4c46-be43-c92e319e000b tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:27.719997 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f5cc7a44-9e3e-4c46-be43-c92e319e000b tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:28.008276 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-f5cc7a44-9e3e-4c46-be43-c92e319e000b tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:28.016387 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-f5cc7a44-9e3e-4c46-be43-c92e319e000b tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1358 microversion: 2.1 time: 0.316358 May 03 21:33:28.016954 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 358/656] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:27 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1358 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:28.434762 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-08f6b222-5948-40b9-aebd-2e57dc57c2c4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:28.435418 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-08f6b222-5948-40b9-aebd-2e57dc57c2c4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 1233302d-c8af-43d2-9b77-4394d2674961] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:28.442601 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-08f6b222-5948-40b9-aebd-2e57dc57c2c4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:28.443044 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-08f6b222-5948-40b9-aebd-2e57dc57c2c4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:28.443803 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-08f6b222-5948-40b9-aebd-2e57dc57c2c4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:28.444228 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-08f6b222-5948-40b9-aebd-2e57dc57c2c4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:28.657593 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-08f6b222-5948-40b9-aebd-2e57dc57c2c4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:28.666623 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-08f6b222-5948-40b9-aebd-2e57dc57c2c4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961" status: 200 len: 1367 microversion: 2.1 time: 0.242164 May 03 21:33:28.667163 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 299/657] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:28 2022] GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961 => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:29.039531 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-f6f207dd-af31-4c97-bbf4-9c4ea949852c tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:29.040246 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-f6f207dd-af31-4c97-bbf4-9c4ea949852c tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:29.047790 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f6f207dd-af31-4c97-bbf4-9c4ea949852c tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:29.048234 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f6f207dd-af31-4c97-bbf4-9c4ea949852c tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:29.049087 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f6f207dd-af31-4c97-bbf4-9c4ea949852c tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:29.049796 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f6f207dd-af31-4c97-bbf4-9c4ea949852c tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:29.209204 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-302a04eb-e325-420b-90a4-a0e501626fba tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:29.210026 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-302a04eb-e325-420b-90a4-a0e501626fba tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:29.219125 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-302a04eb-e325-420b-90a4-a0e501626fba tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:29.219567 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-302a04eb-e325-420b-90a4-a0e501626fba tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:29.220351 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-302a04eb-e325-420b-90a4-a0e501626fba tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:29.220822 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-302a04eb-e325-420b-90a4-a0e501626fba tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:29.286246 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-f6f207dd-af31-4c97-bbf4-9c4ea949852c tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:29.295760 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-f6f207dd-af31-4c97-bbf4-9c4ea949852c tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1358 microversion: 2.1 time: 0.265377 May 03 21:33:29.296419 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 359/658] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:29 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1358 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:33:29.305134 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-302a04eb-e325-420b-90a4-a0e501626fba tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5/os-volume_attachments/1a164502-7caa-4e0b-a280-4d4f0e1be6a1" status: 200 len: 194 microversion: 2.20 time: 0.107684 May 03 21:33:29.305796 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 300/659] 10.222.0.48 () {60 vars in 1453 bytes} [Tue May 3 21:33:29 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5/os-volume_attachments/1a164502-7caa-4e0b-a280-4d4f0e1be6a1 => generated 194 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 03 21:33:29.427921 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-ebaf7ca5-4c3e-4964-83b6-0ab08cb69173 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:29.428662 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-ebaf7ca5-4c3e-4964-83b6-0ab08cb69173 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:29.444933 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ebaf7ca5-4c3e-4964-83b6-0ab08cb69173 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:29.451070 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ebaf7ca5-4c3e-4964-83b6-0ab08cb69173 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:29.451070 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ebaf7ca5-4c3e-4964-83b6-0ab08cb69173 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:29.451070 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ebaf7ca5-4c3e-4964-83b6-0ab08cb69173 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:29.698397 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-b56cbc17-376c-490a-8332-1a551e0b7153 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:29.699718 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-b56cbc17-376c-490a-8332-1a551e0b7153 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 1233302d-c8af-43d2-9b77-4394d2674961] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:29.710201 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b56cbc17-376c-490a-8332-1a551e0b7153 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:29.710834 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b56cbc17-376c-490a-8332-1a551e0b7153 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:29.711735 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b56cbc17-376c-490a-8332-1a551e0b7153 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:29.712412 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b56cbc17-376c-490a-8332-1a551e0b7153 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:30.027702 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-ebaf7ca5-4c3e-4964-83b6-0ab08cb69173 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "DELETE /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5/os-volume_attachments/1a164502-7caa-4e0b-a280-4d4f0e1be6a1" status: 202 len: 0 microversion: 2.20 time: 0.576883 May 03 21:33:30.027702 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 360/660] 10.222.0.48 () {60 vars in 1456 bytes} [Tue May 3 21:33:29 2022] DELETE /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5/os-volume_attachments/1a164502-7caa-4e0b-a280-4d4f0e1be6a1 => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 03 21:33:30.027702 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-68c0895f-fbff-4a6e-a94b-00d78da2cadc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:30.027702 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-68c0895f-fbff-4a6e-a94b-00d78da2cadc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:30.028871 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-68c0895f-fbff-4a6e-a94b-00d78da2cadc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:30.029341 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-68c0895f-fbff-4a6e-a94b-00d78da2cadc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:30.030113 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-68c0895f-fbff-4a6e-a94b-00d78da2cadc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:30.030550 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-68c0895f-fbff-4a6e-a94b-00d78da2cadc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:30.107359 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-68c0895f-fbff-4a6e-a94b-00d78da2cadc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.108903 May 03 21:33:30.108897 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 361/661] 10.222.0.48 () {60 vars in 1342 bytes} [Tue May 3 21:33:29 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 21:33:30.128818 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-b56cbc17-376c-490a-8332-1a551e0b7153 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:30.139452 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-b56cbc17-376c-490a-8332-1a551e0b7153 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961" status: 200 len: 1367 microversion: 2.1 time: 0.453163 May 03 21:33:30.140528 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 301/662] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:29 2022] GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961 => generated 1367 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:33:30.321990 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-e1f0698c-cf00-44d7-a52b-c73b05aa8572 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:30.323213 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-e1f0698c-cf00-44d7-a52b-c73b05aa8572 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:30.346321 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e1f0698c-cf00-44d7-a52b-c73b05aa8572 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:30.347458 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e1f0698c-cf00-44d7-a52b-c73b05aa8572 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:30.349712 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e1f0698c-cf00-44d7-a52b-c73b05aa8572 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:30.351780 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e1f0698c-cf00-44d7-a52b-c73b05aa8572 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:30.663490 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-e1f0698c-cf00-44d7-a52b-c73b05aa8572 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:30.672747 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-e1f0698c-cf00-44d7-a52b-c73b05aa8572 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1358 microversion: 2.1 time: 0.362360 May 03 21:33:30.673590 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 362/663] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:30 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1358 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:31.016666 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-298e601e-7a37-4c0c-98a2-abcbed2f1227 req-8a7c845b-3320-4a49-8381-ff37de7e4ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1233302d-c8af-43d2-9b77-4394d2674961", "tag": "7fa6b06a-f0cf-4a54-8f74-c95315afe030"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:33:31.023167 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:33:31.023167 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:33:31.035842 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-298e601e-7a37-4c0c-98a2-abcbed2f1227 req-8a7c845b-3320-4a49-8381-ff37de7e4ee6 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:31.037091 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-298e601e-7a37-4c0c-98a2-abcbed2f1227 req-8a7c845b-3320-4a49-8381-ff37de7e4ee6 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:31.056533 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-298e601e-7a37-4c0c-98a2-abcbed2f1227 req-8a7c845b-3320-4a49-8381-ff37de7e4ee6 service nova] Creating event network-changed:7fa6b06a-f0cf-4a54-8f74-c95315afe030 for instance 1233302d-c8af-43d2-9b77-4394d2674961 on hv-cinder-84037 May 03 21:33:31.063863 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-298e601e-7a37-4c0c-98a2-abcbed2f1227 req-8a7c845b-3320-4a49-8381-ff37de7e4ee6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058577 May 03 21:33:31.066212 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 302/664] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:33:31.130188 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-7300a720-4d3b-41aa-8281-a6a734ed6985 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:31.137797 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-7300a720-4d3b-41aa-8281-a6a734ed6985 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:31.145851 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7300a720-4d3b-41aa-8281-a6a734ed6985 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:31.156928 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7300a720-4d3b-41aa-8281-a6a734ed6985 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:31.156928 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7300a720-4d3b-41aa-8281-a6a734ed6985 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:31.156928 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7300a720-4d3b-41aa-8281-a6a734ed6985 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:31.167769 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-51c32f14-3c33-4f91-b88a-90e6b7121362 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:31.168634 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-51c32f14-3c33-4f91-b88a-90e6b7121362 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 1233302d-c8af-43d2-9b77-4394d2674961] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:31.190892 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-51c32f14-3c33-4f91-b88a-90e6b7121362 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:31.191714 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-51c32f14-3c33-4f91-b88a-90e6b7121362 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:31.192807 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-51c32f14-3c33-4f91-b88a-90e6b7121362 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:31.193707 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-51c32f14-3c33-4f91-b88a-90e6b7121362 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:31.295538 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-7300a720-4d3b-41aa-8281-a6a734ed6985 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.179651 May 03 21:33:31.296400 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 363/665] 10.222.0.48 () {60 vars in 1342 bytes} [Tue May 3 21:33:31 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5/os-volume_attachments => generated 197 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 21:33:31.697809 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-afb2a245-2c8a-4374-9e80-51ab2be93900 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:31.698525 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-afb2a245-2c8a-4374-9e80-51ab2be93900 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:31.707263 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-afb2a245-2c8a-4374-9e80-51ab2be93900 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:31.708083 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-afb2a245-2c8a-4374-9e80-51ab2be93900 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:31.709031 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-afb2a245-2c8a-4374-9e80-51ab2be93900 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:31.709469 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-afb2a245-2c8a-4374-9e80-51ab2be93900 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:31.796504 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-51c32f14-3c33-4f91-b88a-90e6b7121362 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:31.807406 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-51c32f14-3c33-4f91-b88a-90e6b7121362 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961" status: 200 len: 1367 microversion: 2.1 time: 0.653494 May 03 21:33:31.808145 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 303/666] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:31 2022] GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961 => generated 1367 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:33:31.930152 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-afb2a245-2c8a-4374-9e80-51ab2be93900 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:31.938486 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-afb2a245-2c8a-4374-9e80-51ab2be93900 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1547 microversion: 2.1 time: 0.251131 May 03 21:33:31.939022 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 364/667] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:31 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1547 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:31.964588 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-11e71342-6a33-4e2d-9437-731fb28f1dd4 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:31.964588 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-11e71342-6a33-4e2d-9437-731fb28f1dd4 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:31.969589 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-11e71342-6a33-4e2d-9437-731fb28f1dd4 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:31.970050 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-11e71342-6a33-4e2d-9437-731fb28f1dd4 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:31.970870 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-11e71342-6a33-4e2d-9437-731fb28f1dd4 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:31.971346 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-11e71342-6a33-4e2d-9437-731fb28f1dd4 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:32.315511 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-9af79c44-aa4a-43fd-b935-a218c754acb6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:32.317387 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-9af79c44-aa4a-43fd-b935-a218c754acb6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:32.325213 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9af79c44-aa4a-43fd-b935-a218c754acb6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:32.325410 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9af79c44-aa4a-43fd-b935-a218c754acb6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:32.326382 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9af79c44-aa4a-43fd-b935-a218c754acb6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:32.326870 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9af79c44-aa4a-43fd-b935-a218c754acb6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:32.328088 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-11e71342-6a33-4e2d-9437-731fb28f1dd4 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:32.338930 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-11e71342-6a33-4e2d-9437-731fb28f1dd4 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1547 microversion: 2.1 time: 0.387230 May 03 21:33:32.350590 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 304/668] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:31 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1547 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:32.367251 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-8378dba2-fac0-43d9-ae59-6a0f0b41a47a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:32.391494 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:33:32.391494 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:33:32.392208 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-8378dba2-fac0-43d9-ae59-6a0f0b41a47a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:32.393333 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-8378dba2-fac0-43d9-ae59-6a0f0b41a47a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Searching by: {'deleted': False, 'project_id': '03af834dfea4426086d2125bcea03d0f'} {{(pid=97831) get_all /opt/stack/nova/nova/compute/api.py:2852}} May 03 21:33:32.399888 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8378dba2-fac0-43d9-ae59-6a0f0b41a47a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:32.400327 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8378dba2-fac0-43d9-ae59-6a0f0b41a47a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:32.401318 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8378dba2-fac0-43d9-ae59-6a0f0b41a47a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:32.401763 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8378dba2-fac0-43d9-ae59-6a0f0b41a47a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:32.418537 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-9af79c44-aa4a-43fd-b935-a218c754acb6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.112664 May 03 21:33:32.419497 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 365/669] 10.222.0.48 () {60 vars in 1342 bytes} [Tue May 3 21:33:32 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5/os-volume_attachments => generated 25 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:33:32.537876 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.multi_cell_list [None req-8378dba2-fac0-43d9-ae59-6a0f0b41a47a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=97831) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} May 03 21:33:32.547591 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-00346475-01ee-44cb-aeee-dab6305d33de tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:32.550424 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-00346475-01ee-44cb-aeee-dab6305d33de tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:32.560056 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-00346475-01ee-44cb-aeee-dab6305d33de tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:32.561854 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-00346475-01ee-44cb-aeee-dab6305d33de tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:32.562341 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-00346475-01ee-44cb-aeee-dab6305d33de tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:32.562950 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-00346475-01ee-44cb-aeee-dab6305d33de tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:32.647517 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-00346475-01ee-44cb-aeee-dab6305d33de tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Going to try to terminate instance {{(pid=97832) delete /opt/stack/nova/nova/compute/api.py:2559}} May 03 21:33:32.648385 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-8378dba2-fac0-43d9-ae59-6a0f0b41a47a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.295929 May 03 21:33:32.648995 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 305/670] 10.222.0.48 () {58 vars in 1124 bytes} [Tue May 3 21:33:32 2022] GET /compute/v2.1/servers => generated 342 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:33:32.667547 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-3be67a85-a74a-4841-b55a-b13aa6f2dc88 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:32.668266 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-3be67a85-a74a-4841-b55a-b13aa6f2dc88 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:32.677005 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-3be67a85-a74a-4841-b55a-b13aa6f2dc88 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:32.677562 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-3be67a85-a74a-4841-b55a-b13aa6f2dc88 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:32.678420 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-3be67a85-a74a-4841-b55a-b13aa6f2dc88 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:32.678852 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-3be67a85-a74a-4841-b55a-b13aa6f2dc88 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:32.895831 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-3be67a85-a74a-4841-b55a-b13aa6f2dc88 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:32.905060 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-3be67a85-a74a-4841-b55a-b13aa6f2dc88 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1547 microversion: 2.1 time: 0.247879 May 03 21:33:32.905060 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 306/671] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:32 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1547 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:33:32.916948 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-1c843ad8-8643-4610-bd90-dc9d942b3c55 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:32.917582 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-1c843ad8-8643-4610-bd90-dc9d942b3c55 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 1233302d-c8af-43d2-9b77-4394d2674961] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:32.925850 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1c843ad8-8643-4610-bd90-dc9d942b3c55 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:32.926302 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1c843ad8-8643-4610-bd90-dc9d942b3c55 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:32.927086 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1c843ad8-8643-4610-bd90-dc9d942b3c55 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:32.927524 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1c843ad8-8643-4610-bd90-dc9d942b3c55 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:33.171676 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-1c843ad8-8643-4610-bd90-dc9d942b3c55 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:33.181836 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-1c843ad8-8643-4610-bd90-dc9d942b3c55 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961" status: 200 len: 1367 microversion: 2.1 time: 0.275790 May 03 21:33:33.182386 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 307/672] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:32 2022] GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961 => generated 1367 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:33.239370 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-00346475-01ee-44cb-aeee-dab6305d33de tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "DELETE /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 204 len: 0 microversion: 2.20 time: 0.703917 May 03 21:33:33.239951 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 366/673] 10.222.0.48 () {60 vars in 1279 bytes} [Tue May 3 21:33:32 2022] DELETE /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 03 21:33:33.255167 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-7ba75cdc-c9af-400e-b2c7-757ca9dbe30b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:33.255775 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-7ba75cdc-c9af-400e-b2c7-757ca9dbe30b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:33.263210 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7ba75cdc-c9af-400e-b2c7-757ca9dbe30b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:33.263753 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7ba75cdc-c9af-400e-b2c7-757ca9dbe30b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:33.264887 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7ba75cdc-c9af-400e-b2c7-757ca9dbe30b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:33.265385 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7ba75cdc-c9af-400e-b2c7-757ca9dbe30b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:33.519428 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-7ba75cdc-c9af-400e-b2c7-757ca9dbe30b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:33.535582 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-7ba75cdc-c9af-400e-b2c7-757ca9dbe30b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:33.542440 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-7ba75cdc-c9af-400e-b2c7-757ca9dbe30b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:33.543590 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-7ba75cdc-c9af-400e-b2c7-757ca9dbe30b tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1723 microversion: 2.20 time: 0.299318 May 03 21:33:33.544117 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 308/674] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:33:33 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1723 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 21:33:34.209077 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-d17da7a2-dc85-4a0e-b27c-2c8dc738eec4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:34.209917 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-d17da7a2-dc85-4a0e-b27c-2c8dc738eec4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 1233302d-c8af-43d2-9b77-4394d2674961] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:34.218964 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d17da7a2-dc85-4a0e-b27c-2c8dc738eec4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:34.220180 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d17da7a2-dc85-4a0e-b27c-2c8dc738eec4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:34.222264 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d17da7a2-dc85-4a0e-b27c-2c8dc738eec4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:34.222854 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d17da7a2-dc85-4a0e-b27c-2c8dc738eec4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:34.443662 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-d17da7a2-dc85-4a0e-b27c-2c8dc738eec4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:34.452009 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-d17da7a2-dc85-4a0e-b27c-2c8dc738eec4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961" status: 200 len: 1367 microversion: 2.1 time: 0.255003 May 03 21:33:34.452571 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 367/675] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:34 2022] GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961 => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:33:34.572691 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-9603d8c3-e32d-4c5a-8264-e4c2f0c31502 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:34.573567 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-9603d8c3-e32d-4c5a-8264-e4c2f0c31502 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:34.581733 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9603d8c3-e32d-4c5a-8264-e4c2f0c31502 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:34.582181 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9603d8c3-e32d-4c5a-8264-e4c2f0c31502 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:34.582999 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9603d8c3-e32d-4c5a-8264-e4c2f0c31502 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:34.583400 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9603d8c3-e32d-4c5a-8264-e4c2f0c31502 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:34.820115 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-9603d8c3-e32d-4c5a-8264-e4c2f0c31502 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:34.836624 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-9603d8c3-e32d-4c5a-8264-e4c2f0c31502 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:34.836624 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-9603d8c3-e32d-4c5a-8264-e4c2f0c31502 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:34.836624 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-9603d8c3-e32d-4c5a-8264-e4c2f0c31502 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1723 microversion: 2.20 time: 0.274147 May 03 21:33:34.836937 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 309/676] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:33:34 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1723 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:33:35.253243 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-cb4a8839-c13e-4468-9a9a-eb5f6b9c839b tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00f030a2-494e-4d19-8410-3ca3ef055bd5"}} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:33:35.254525 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-cb4a8839-c13e-4468-9a9a-eb5f6b9c839b tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:35.262579 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cb4a8839-c13e-4468-9a9a-eb5f6b9c839b tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:35.263364 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cb4a8839-c13e-4468-9a9a-eb5f6b9c839b tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:35.264174 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cb4a8839-c13e-4468-9a9a-eb5f6b9c839b tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:35.264656 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cb4a8839-c13e-4468-9a9a-eb5f6b9c839b tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:35.476452 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-517c4d17-ca06-4139-a76d-9efedb175b66 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:35.477175 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-517c4d17-ca06-4139-a76d-9efedb175b66 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 1233302d-c8af-43d2-9b77-4394d2674961] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:35.484536 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-517c4d17-ca06-4139-a76d-9efedb175b66 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:35.485067 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-517c4d17-ca06-4139-a76d-9efedb175b66 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:35.486041 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-517c4d17-ca06-4139-a76d-9efedb175b66 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:35.487119 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-517c4d17-ca06-4139-a76d-9efedb175b66 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:35.834540 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-517c4d17-ca06-4139-a76d-9efedb175b66 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:35.855444 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-517c4d17-ca06-4139-a76d-9efedb175b66 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961" status: 200 len: 1367 microversion: 2.1 time: 0.383970 May 03 21:33:35.855444 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 310/677] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:35 2022] GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961 => generated 1367 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:33:35.865005 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-c928d1e4-b386-41f9-9bae-62b5b4ba824f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:35.865785 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-c928d1e4-b386-41f9-9bae-62b5b4ba824f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:35.883782 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c928d1e4-b386-41f9-9bae-62b5b4ba824f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:35.884253 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c928d1e4-b386-41f9-9bae-62b5b4ba824f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:35.885142 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c928d1e4-b386-41f9-9bae-62b5b4ba824f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:35.885592 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c928d1e4-b386-41f9-9bae-62b5b4ba824f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:36.416493 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-c928d1e4-b386-41f9-9bae-62b5b4ba824f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:36.430984 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-c928d1e4-b386-41f9-9bae-62b5b4ba824f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:36.437264 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-c928d1e4-b386-41f9-9bae-62b5b4ba824f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:36.438384 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-c928d1e4-b386-41f9-9bae-62b5b4ba824f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1723 microversion: 2.20 time: 0.586251 May 03 21:33:36.438905 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 311/678] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:33:35 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1723 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:33:36.522817 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-cb4a8839-c13e-4468-9a9a-eb5f6b9c839b tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "POST /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.279705 May 03 21:33:36.523735 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 368/679] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 3 21:33:35 2022] POST /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42/os-volume_attachments => generated 194 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:33:36.879643 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-e90f78ed-6c8c-4c2f-b2a3-d4674a306e64 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:36.880325 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-e90f78ed-6c8c-4c2f-b2a3-d4674a306e64 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 1233302d-c8af-43d2-9b77-4394d2674961] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:36.887643 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e90f78ed-6c8c-4c2f-b2a3-d4674a306e64 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:36.888096 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e90f78ed-6c8c-4c2f-b2a3-d4674a306e64 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:36.888906 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e90f78ed-6c8c-4c2f-b2a3-d4674a306e64 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:36.889339 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e90f78ed-6c8c-4c2f-b2a3-d4674a306e64 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:37.290035 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-e90f78ed-6c8c-4c2f-b2a3-d4674a306e64 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:37.300019 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-e90f78ed-6c8c-4c2f-b2a3-d4674a306e64 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961" status: 200 len: 1367 microversion: 2.1 time: 0.429397 May 03 21:33:37.301207 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 312/680] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:36 2022] GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961 => generated 1367 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:37.407163 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-ce10ed16-c2ec-469d-85d2-db9c3b2609e4 req-fe6a86af-e7a9-4f88-8381-6a6e175e66df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1233302d-c8af-43d2-9b77-4394d2674961", "name": "network-vif-plugged", "status": "completed", "tag": "7fa6b06a-f0cf-4a54-8f74-c95315afe030"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:33:37.415062 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:33:37.415062 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:33:37.426720 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-ce10ed16-c2ec-469d-85d2-db9c3b2609e4 req-fe6a86af-e7a9-4f88-8381-6a6e175e66df service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:37.427449 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-ce10ed16-c2ec-469d-85d2-db9c3b2609e4 req-fe6a86af-e7a9-4f88-8381-6a6e175e66df service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:37.445626 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-ce10ed16-c2ec-469d-85d2-db9c3b2609e4 req-fe6a86af-e7a9-4f88-8381-6a6e175e66df service nova] Creating event network-vif-plugged:7fa6b06a-f0cf-4a54-8f74-c95315afe030 for instance 1233302d-c8af-43d2-9b77-4394d2674961 on hv-cinder-84037 May 03 21:33:37.460357 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-ce10ed16-c2ec-469d-85d2-db9c3b2609e4 req-fe6a86af-e7a9-4f88-8381-6a6e175e66df service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057059 May 03 21:33:37.460357 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 369/681] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:33:37.479597 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-5d5aa549-e95e-434d-a2f7-b07c418b7729 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:37.480574 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-5d5aa549-e95e-434d-a2f7-b07c418b7729 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:37.505107 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5d5aa549-e95e-434d-a2f7-b07c418b7729 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:37.505107 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5d5aa549-e95e-434d-a2f7-b07c418b7729 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:37.505107 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5d5aa549-e95e-434d-a2f7-b07c418b7729 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:37.505107 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5d5aa549-e95e-434d-a2f7-b07c418b7729 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:37.738535 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-5d5aa549-e95e-434d-a2f7-b07c418b7729 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:37.747365 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-6b340600-d6ff-476c-bdc8-6e994fdc1e58 req-d95808ef-3272-416d-8ef5-7ea5feb5004c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f6a8a2-4366-486d-a002-05587e0f46b5", "name": "network-vif-deleted", "tag": "be428a12-3d87-4da1-a665-e7b79df6af66"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:33:37.761196 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:33:37.761196 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:33:37.764796 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-5d5aa549-e95e-434d-a2f7-b07c418b7729 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:37.773609 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-5d5aa549-e95e-434d-a2f7-b07c418b7729 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:37.774419 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-6b340600-d6ff-476c-bdc8-6e994fdc1e58 req-d95808ef-3272-416d-8ef5-7ea5feb5004c service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:37.775243 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-5d5aa549-e95e-434d-a2f7-b07c418b7729 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1655 microversion: 2.20 time: 0.321856 May 03 21:33:37.775464 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-6b340600-d6ff-476c-bdc8-6e994fdc1e58 req-d95808ef-3272-416d-8ef5-7ea5feb5004c service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:37.776597 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 313/682] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:33:37 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1655 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:33:37.797736 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-6b340600-d6ff-476c-bdc8-6e994fdc1e58 req-d95808ef-3272-416d-8ef5-7ea5feb5004c service nova] Creating event network-vif-deleted:be428a12-3d87-4da1-a665-e7b79df6af66 for instance 77f6a8a2-4366-486d-a002-05587e0f46b5 on hv-cinder-84037 May 03 21:33:37.803660 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-6b340600-d6ff-476c-bdc8-6e994fdc1e58 req-d95808ef-3272-416d-8ef5-7ea5feb5004c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066004 May 03 21:33:37.804318 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 370/683] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:33:38.325592 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-fd0edc1a-e81e-4caa-9ec5-b53ec28d7e0b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:38.326487 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-fd0edc1a-e81e-4caa-9ec5-b53ec28d7e0b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 1233302d-c8af-43d2-9b77-4394d2674961] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:38.338525 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fd0edc1a-e81e-4caa-9ec5-b53ec28d7e0b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:38.338988 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fd0edc1a-e81e-4caa-9ec5-b53ec28d7e0b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:38.339940 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fd0edc1a-e81e-4caa-9ec5-b53ec28d7e0b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:38.340553 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fd0edc1a-e81e-4caa-9ec5-b53ec28d7e0b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:38.573842 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-fd0edc1a-e81e-4caa-9ec5-b53ec28d7e0b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:38.582961 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-fd0edc1a-e81e-4caa-9ec5-b53ec28d7e0b tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961" status: 200 len: 1367 microversion: 2.1 time: 0.268800 May 03 21:33:38.583717 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 314/684] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:38 2022] GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961 => generated 1367 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:38.806218 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-85ccb488-721d-4d9a-b2e2-bcab0446760a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:38.807110 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-85ccb488-721d-4d9a-b2e2-bcab0446760a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:38.815053 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-85ccb488-721d-4d9a-b2e2-bcab0446760a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:38.815716 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-85ccb488-721d-4d9a-b2e2-bcab0446760a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:38.816633 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-85ccb488-721d-4d9a-b2e2-bcab0446760a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:38.817065 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-85ccb488-721d-4d9a-b2e2-bcab0446760a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:38.903061 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-85ccb488-721d-4d9a-b2e2-bcab0446760a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:38.903500 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-85ccb488-721d-4d9a-b2e2-bcab0446760a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:38.903946 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.objects.instance [None req-85ccb488-721d-4d9a-b2e2-bcab0446760a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lazy-loading 'fault' on Instance uuid 77f6a8a2-4366-486d-a002-05587e0f46b5 {{(pid=97832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 03 21:33:38.970588 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-85ccb488-721d-4d9a-b2e2-bcab0446760a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:38.984928 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-85ccb488-721d-4d9a-b2e2-bcab0446760a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:38.993078 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-85ccb488-721d-4d9a-b2e2-bcab0446760a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:38.994631 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-85ccb488-721d-4d9a-b2e2-bcab0446760a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1370 microversion: 2.20 time: 0.199370 May 03 21:33:38.995450 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 371/685] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:33:38 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1370 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:33:39.606586 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-208617a1-1423-4049-951e-b77a2cfed304 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:39.607285 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-208617a1-1423-4049-951e-b77a2cfed304 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 1233302d-c8af-43d2-9b77-4394d2674961] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:39.615963 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-208617a1-1423-4049-951e-b77a2cfed304 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:39.616344 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-208617a1-1423-4049-951e-b77a2cfed304 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:39.617248 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-208617a1-1423-4049-951e-b77a2cfed304 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:39.617684 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-208617a1-1423-4049-951e-b77a2cfed304 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:39.839835 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-208617a1-1423-4049-951e-b77a2cfed304 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:39.850931 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-208617a1-1423-4049-951e-b77a2cfed304 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961" status: 200 len: 1367 microversion: 2.1 time: 0.253328 May 03 21:33:39.851508 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 315/686] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:39 2022] GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961 => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:40.019451 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-9835002d-e82d-4a3b-bd15-c418af9b9c69 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:40.020051 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-9835002d-e82d-4a3b-bd15-c418af9b9c69 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:40.028666 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9835002d-e82d-4a3b-bd15-c418af9b9c69 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:40.029178 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9835002d-e82d-4a3b-bd15-c418af9b9c69 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:40.029951 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9835002d-e82d-4a3b-bd15-c418af9b9c69 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:40.030392 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9835002d-e82d-4a3b-bd15-c418af9b9c69 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:40.111499 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9835002d-e82d-4a3b-bd15-c418af9b9c69 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:40.112557 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9835002d-e82d-4a3b-bd15-c418af9b9c69 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:40.113059 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.objects.instance [None req-9835002d-e82d-4a3b-bd15-c418af9b9c69 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lazy-loading 'fault' on Instance uuid 77f6a8a2-4366-486d-a002-05587e0f46b5 {{(pid=97832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 03 21:33:40.180244 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-9835002d-e82d-4a3b-bd15-c418af9b9c69 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:40.195042 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-9835002d-e82d-4a3b-bd15-c418af9b9c69 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:40.201275 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-9835002d-e82d-4a3b-bd15-c418af9b9c69 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:40.202376 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-9835002d-e82d-4a3b-bd15-c418af9b9c69 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1370 microversion: 2.20 time: 0.192269 May 03 21:33:40.202880 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 372/687] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:33:40 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1370 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:33:40.874675 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-676da3bf-52fc-4352-b949-6159f4addbba tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:40.875467 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-676da3bf-52fc-4352-b949-6159f4addbba tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 1233302d-c8af-43d2-9b77-4394d2674961] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:40.883412 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-676da3bf-52fc-4352-b949-6159f4addbba tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:40.886342 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-676da3bf-52fc-4352-b949-6159f4addbba tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:40.886342 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-676da3bf-52fc-4352-b949-6159f4addbba tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:40.886342 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-676da3bf-52fc-4352-b949-6159f4addbba tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:41.116010 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-676da3bf-52fc-4352-b949-6159f4addbba tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:41.126417 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-676da3bf-52fc-4352-b949-6159f4addbba tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961" status: 200 len: 1367 microversion: 2.1 time: 0.261900 May 03 21:33:41.126913 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 316/688] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:40 2022] GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961 => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:41.227795 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-546fd563-80b1-4012-842e-25ee35ecca75 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:41.228384 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-546fd563-80b1-4012-842e-25ee35ecca75 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:41.235782 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-546fd563-80b1-4012-842e-25ee35ecca75 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:41.237080 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-546fd563-80b1-4012-842e-25ee35ecca75 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:41.237793 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-546fd563-80b1-4012-842e-25ee35ecca75 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:41.238281 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-546fd563-80b1-4012-842e-25ee35ecca75 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:41.315093 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-546fd563-80b1-4012-842e-25ee35ecca75 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:41.315538 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-546fd563-80b1-4012-842e-25ee35ecca75 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:41.315990 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.objects.instance [None req-546fd563-80b1-4012-842e-25ee35ecca75 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lazy-loading 'fault' on Instance uuid 77f6a8a2-4366-486d-a002-05587e0f46b5 {{(pid=97832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 03 21:33:41.381492 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-546fd563-80b1-4012-842e-25ee35ecca75 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:41.397113 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-546fd563-80b1-4012-842e-25ee35ecca75 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:41.403455 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-546fd563-80b1-4012-842e-25ee35ecca75 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:41.404684 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-546fd563-80b1-4012-842e-25ee35ecca75 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1370 microversion: 2.20 time: 0.187009 May 03 21:33:41.405242 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 373/689] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:33:41 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1370 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:33:42.149409 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-87f5e459-632d-47a5-a435-97e14380b519 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:42.150086 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-87f5e459-632d-47a5-a435-97e14380b519 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 1233302d-c8af-43d2-9b77-4394d2674961] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:42.157552 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-87f5e459-632d-47a5-a435-97e14380b519 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:42.158003 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-87f5e459-632d-47a5-a435-97e14380b519 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:42.159534 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-87f5e459-632d-47a5-a435-97e14380b519 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:42.159948 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-87f5e459-632d-47a5-a435-97e14380b519 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:42.387198 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-87f5e459-632d-47a5-a435-97e14380b519 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:42.398058 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-87f5e459-632d-47a5-a435-97e14380b519 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961" status: 200 len: 1367 microversion: 2.1 time: 0.258701 May 03 21:33:42.399291 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 317/690] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:42 2022] GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961 => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:42.434211 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-3287b50c-1639-4ac4-9199-7cda1bfa51d6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:42.435784 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-3287b50c-1639-4ac4-9199-7cda1bfa51d6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:42.444854 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3287b50c-1639-4ac4-9199-7cda1bfa51d6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:42.450015 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3287b50c-1639-4ac4-9199-7cda1bfa51d6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:42.450015 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3287b50c-1639-4ac4-9199-7cda1bfa51d6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:42.450015 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3287b50c-1639-4ac4-9199-7cda1bfa51d6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:42.533779 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3287b50c-1639-4ac4-9199-7cda1bfa51d6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:42.534219 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3287b50c-1639-4ac4-9199-7cda1bfa51d6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:42.534664 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.objects.instance [None req-3287b50c-1639-4ac4-9199-7cda1bfa51d6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lazy-loading 'fault' on Instance uuid 77f6a8a2-4366-486d-a002-05587e0f46b5 {{(pid=97832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 03 21:33:42.595057 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-3287b50c-1639-4ac4-9199-7cda1bfa51d6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:42.609289 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-3287b50c-1639-4ac4-9199-7cda1bfa51d6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:42.618026 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-3287b50c-1639-4ac4-9199-7cda1bfa51d6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:42.619311 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-3287b50c-1639-4ac4-9199-7cda1bfa51d6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 200 len: 1370 microversion: 2.20 time: 0.199623 May 03 21:33:42.620948 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 374/691] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:33:42 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 1370 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:33:43.420954 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-4d694d60-7c52-4edb-a1f8-07cebbb42752 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:43.422176 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-4d694d60-7c52-4edb-a1f8-07cebbb42752 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 1233302d-c8af-43d2-9b77-4394d2674961] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:43.430469 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4d694d60-7c52-4edb-a1f8-07cebbb42752 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:43.430930 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4d694d60-7c52-4edb-a1f8-07cebbb42752 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:43.431723 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4d694d60-7c52-4edb-a1f8-07cebbb42752 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:43.432159 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4d694d60-7c52-4edb-a1f8-07cebbb42752 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:43.643791 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-c34fb251-4471-48b3-bcf9-476200d772a3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:43.644403 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-c34fb251-4471-48b3-bcf9-476200d772a3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:43.649815 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-4d694d60-7c52-4edb-a1f8-07cebbb42752 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:43.651795 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c34fb251-4471-48b3-bcf9-476200d772a3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:43.652245 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c34fb251-4471-48b3-bcf9-476200d772a3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:43.653127 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c34fb251-4471-48b3-bcf9-476200d772a3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:43.653517 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c34fb251-4471-48b3-bcf9-476200d772a3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:43.660535 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-4d694d60-7c52-4edb-a1f8-07cebbb42752 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961" status: 200 len: 1556 microversion: 2.1 time: 0.248854 May 03 21:33:43.664477 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 318/692] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:43 2022] GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961 => generated 1556 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:43.691624 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-05259dd8-c999-4678-9d69-21db0c47ef04 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:43.692210 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-05259dd8-c999-4678-9d69-21db0c47ef04 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 1233302d-c8af-43d2-9b77-4394d2674961] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:43.699963 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-05259dd8-c999-4678-9d69-21db0c47ef04 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:43.700638 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-05259dd8-c999-4678-9d69-21db0c47ef04 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:43.701464 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-05259dd8-c999-4678-9d69-21db0c47ef04 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:43.701890 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-05259dd8-c999-4678-9d69-21db0c47ef04 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:43.705831 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.wsgi [None req-c34fb251-4471-48b3-bcf9-476200d772a3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] HTTP exception thrown: Instance 77f6a8a2-4366-486d-a002-05587e0f46b5 could not be found. May 03 21:33:43.709495 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-c34fb251-4471-48b3-bcf9-476200d772a3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Returning 404 to user: Instance 77f6a8a2-4366-486d-a002-05587e0f46b5 could not be found. {{(pid=97832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:33:43.709495 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-c34fb251-4471-48b3-bcf9-476200d772a3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 404 len: 111 microversion: 2.20 time: 0.073304 May 03 21:33:43.709495 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 375/693] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:33:43 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 03 21:33:43.722038 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-a041fd7e-8ed8-4fe6-b177-dbb79503c168 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '.version_select at 0x7fc84ce22af0>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:43.839462 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-a041fd7e-8ed8-4fe6-b177-dbb79503c168 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-217153273" status: 204 len: 0 microversion: 2.20 time: 0.126575 May 03 21:33:43.840069 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 376/694] 10.222.0.48 () {60 vars in 1258 bytes} [Tue May 3 21:33:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-217153273 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 03 21:33:43.862205 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-05259dd8-c999-4678-9d69-21db0c47ef04 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.187726 May 03 21:33:43.862807 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 319/695] 10.222.0.48 () {58 vars in 1274 bytes} [Tue May 3 21:33:43 2022] GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961/os-interface => generated 284 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:33:45.334322 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-7f3fcd61-9e55-4f5e-97c1-88a69ba6ad8a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Action: 'create', calling method: .version_select at 0x7fc84cbabb80>, body: {"keypair": {"name": "tempest-keypair-2026851875"}} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:33:45.361907 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-7f3fcd61-9e55-4f5e-97c1-88a69ba6ad8a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Getting quotas for project 4cf52ffb4a864a689f5d0242ddc4cc4f. Resources: {'key_pairs'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:33:45.366095 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-7f3fcd61-9e55-4f5e-97c1-88a69ba6ad8a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Getting quotas for user 2f7bb76fefa8402db231ed466d351631 and project 4cf52ffb4a864a689f5d0242ddc4cc4f. Resources: {'key_pairs'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:33:45.797895 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-100f4025-3c5c-4958-b8ee-de122faec57d req-3dfac96d-b562-442c-ab5d-6fd7371293b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1233302d-c8af-43d2-9b77-4394d2674961", "tag": "7fa6b06a-f0cf-4a54-8f74-c95315afe030"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:33:45.804437 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:33:45.804437 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:33:45.813862 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-100f4025-3c5c-4958-b8ee-de122faec57d req-3dfac96d-b562-442c-ab5d-6fd7371293b2 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:45.814335 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-100f4025-3c5c-4958-b8ee-de122faec57d req-3dfac96d-b562-442c-ab5d-6fd7371293b2 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:45.833158 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-100f4025-3c5c-4958-b8ee-de122faec57d req-3dfac96d-b562-442c-ab5d-6fd7371293b2 service nova] Creating event network-changed:7fa6b06a-f0cf-4a54-8f74-c95315afe030 for instance 1233302d-c8af-43d2-9b77-4394d2674961 on hv-cinder-84037 May 03 21:33:45.838561 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-100f4025-3c5c-4958-b8ee-de122faec57d req-3dfac96d-b562-442c-ab5d-6fd7371293b2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051663 May 03 21:33:45.839921 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 320/696] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:33:46.039109 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-7f3fcd61-9e55-4f5e-97c1-88a69ba6ad8a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Getting quotas for project 4cf52ffb4a864a689f5d0242ddc4cc4f. Resources: {'key_pairs'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:33:46.052238 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-7f3fcd61-9e55-4f5e-97c1-88a69ba6ad8a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Getting quotas for user 2f7bb76fefa8402db231ed466d351631 and project 4cf52ffb4a864a689f5d0242ddc4cc4f. Resources: {'key_pairs'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:33:46.069122 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-1fdc7087-b945-4b81-93c9-fe68a3dfcf1e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:46.070112 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-1fdc7087-b945-4b81-93c9-fe68a3dfcf1e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:46.079501 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1fdc7087-b945-4b81-93c9-fe68a3dfcf1e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:46.080270 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1fdc7087-b945-4b81-93c9-fe68a3dfcf1e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:46.081454 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1fdc7087-b945-4b81-93c9-fe68a3dfcf1e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:46.081649 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-7f3fcd61-9e55-4f5e-97c1-88a69ba6ad8a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.756477 May 03 21:33:46.082558 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 377/697] 10.222.0.48 () {62 vars in 1198 bytes} [Tue May 3 21:33:45 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 758 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) May 03 21:33:46.083170 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1fdc7087-b945-4b81-93c9-fe68a3dfcf1e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:46.504294 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-1fdc7087-b945-4b81-93c9-fe68a3dfcf1e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:46.516629 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-1fdc7087-b945-4b81-93c9-fe68a3dfcf1e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1593 microversion: 2.1 time: 0.462368 May 03 21:33:46.518396 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 321/698] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:46 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1593 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:51.484681 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-29710374-1f7c-4613-b179-f393ff72e053 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1793292822", "imageRef": "f5214328-64f1-4aa6-aa05-61f0189e0e1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a76ba353-ab28-4792-b070-a9ace23ad085"}], "security_groups": [{"name": "tempest-securitygroup--376181301"}], "key_name": "tempest-keypair-2026851875", "user_data": "}} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:33:51.511165 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-f9f62ac8-7663-4993-ac57-a4f56827b195 req-4dddcf5d-52a8-414e-8578-acbfd72bd6b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f13ba9d5-9344-4748-8e24-118858bfce42", "tag": "85f0f545-6b51-41b2-a9ee-a8c17abc2f57"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:33:51.522835 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:33:51.522835 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:33:51.533071 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-f9f62ac8-7663-4993-ac57-a4f56827b195 req-4dddcf5d-52a8-414e-8578-acbfd72bd6b9 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:51.533682 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-f9f62ac8-7663-4993-ac57-a4f56827b195 req-4dddcf5d-52a8-414e-8578-acbfd72bd6b9 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:51.566173 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-f9f62ac8-7663-4993-ac57-a4f56827b195 req-4dddcf5d-52a8-414e-8578-acbfd72bd6b9 service nova] Creating event network-changed:85f0f545-6b51-41b2-a9ee-a8c17abc2f57 for instance f13ba9d5-9344-4748-8e24-118858bfce42 on hv-cinder-84037 May 03 21:33:51.571593 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-f9f62ac8-7663-4993-ac57-a4f56827b195 req-4dddcf5d-52a8-414e-8578-acbfd72bd6b9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077151 May 03 21:33:51.572189 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 322/699] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:33:51.791913 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.network.neutron [None req-29710374-1f7c-4613-b179-f393ff72e053 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] validate_networks() for [('a76ba353-ab28-4792-b070-a9ace23ad085', None, None, None)] {{(pid=97832) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} May 03 21:33:52.664150 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-29710374-1f7c-4613-b179-f393ff72e053 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Flavor limits 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} May 03 21:33:52.664738 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-29710374-1f7c-4613-b179-f393ff72e053 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Image limits 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} May 03 21:33:52.665658 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-29710374-1f7c-4613-b179-f393ff72e053 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Flavor pref 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} May 03 21:33:52.666299 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-29710374-1f7c-4613-b179-f393ff72e053 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Image pref 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} May 03 21:33:52.666929 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-29710374-1f7c-4613-b179-f393ff72e053 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} May 03 21:33:52.678757 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-29710374-1f7c-4613-b179-f393ff72e053 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:52.679216 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-29710374-1f7c-4613-b179-f393ff72e053 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:52.680701 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-29710374-1f7c-4613-b179-f393ff72e053 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:52.681139 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-29710374-1f7c-4613-b179-f393ff72e053 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:52.706227 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-29710374-1f7c-4613-b179-f393ff72e053 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Getting quotas for project 4cf52ffb4a864a689f5d0242ddc4cc4f. Resources: {'instances', 'ram', 'cores'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:33:52.711385 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-29710374-1f7c-4613-b179-f393ff72e053 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Getting quotas for user 2f7bb76fefa8402db231ed466d351631 and project 4cf52ffb4a864a689f5d0242ddc4cc4f. Resources: {'instances', 'ram', 'cores'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:33:52.726577 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-29710374-1f7c-4613-b179-f393ff72e053 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Going to run 1 instances... {{(pid=97832) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} May 03 21:33:52.729757 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-29710374-1f7c-4613-b179-f393ff72e053 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5214328-64f1-4aa6-aa05-61f0189e0e1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=97832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} May 03 21:33:53.041065 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-29710374-1f7c-4613-b179-f393ff72e053 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.566396 May 03 21:33:53.041810 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 378/700] 10.222.0.48 () {62 vars in 1187 bytes} [Tue May 3 21:33:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 1568 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 03 21:33:53.163727 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-0b2ed00d-6dea-42d0-948b-f105f8f88253 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:53.164520 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-0b2ed00d-6dea-42d0-948b-f105f8f88253 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:53.267941 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-0b2ed00d-6dea-42d0-948b-f105f8f88253 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:53.285225 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-0b2ed00d-6dea-42d0-948b-f105f8f88253 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:53.295226 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-0b2ed00d-6dea-42d0-948b-f105f8f88253 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:53.296684 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-0b2ed00d-6dea-42d0-948b-f105f8f88253 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1282 microversion: 2.20 time: 0.248366 May 03 21:33:53.307286 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 323/701] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:33:53 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1282 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:33:54.325775 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-fd7fb1a4-65d9-4d33-87ee-b8785e236c52 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:54.325775 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-fd7fb1a4-65d9-4d33-87ee-b8785e236c52 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:54.408663 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-fd7fb1a4-65d9-4d33-87ee-b8785e236c52 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:54.421278 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-fd7fb1a4-65d9-4d33-87ee-b8785e236c52 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:54.428257 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-fd7fb1a4-65d9-4d33-87ee-b8785e236c52 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:54.429355 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-fd7fb1a4-65d9-4d33-87ee-b8785e236c52 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1282 microversion: 2.20 time: 0.118144 May 03 21:33:54.429869 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 379/702] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:33:54 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1282 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:33:55.452935 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-c39f63bc-affb-4106-8fbc-f188c3a35795 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:55.453538 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-c39f63bc-affb-4106-8fbc-f188c3a35795 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:55.462612 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c39f63bc-affb-4106-8fbc-f188c3a35795 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:55.463059 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c39f63bc-affb-4106-8fbc-f188c3a35795 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:55.463883 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c39f63bc-affb-4106-8fbc-f188c3a35795 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:55.464391 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c39f63bc-affb-4106-8fbc-f188c3a35795 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:55.608590 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-c39f63bc-affb-4106-8fbc-f188c3a35795 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:55.622537 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-fbce9609-f876-4bd5-9096-4be3e6dfbe9f tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1209098754"}} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:33:55.623115 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-fbce9609-f876-4bd5-9096-4be3e6dfbe9f tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:55.623470 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-c39f63bc-affb-4106-8fbc-f188c3a35795 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:55.629992 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-c39f63bc-affb-4106-8fbc-f188c3a35795 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:55.630883 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fbce9609-f876-4bd5-9096-4be3e6dfbe9f tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:55.634703 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-c39f63bc-affb-4106-8fbc-f188c3a35795 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1286 microversion: 2.20 time: 0.187473 May 03 21:33:55.634815 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fbce9609-f876-4bd5-9096-4be3e6dfbe9f tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:55.634910 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 324/703] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:33:55 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1286 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:33:55.635034 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fbce9609-f876-4bd5-9096-4be3e6dfbe9f tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:55.635034 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fbce9609-f876-4bd5-9096-4be3e6dfbe9f tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:55.836916 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.network.security_group_api [None req-fbce9609-f876-4bd5-9096-4be3e6dfbe9f tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Adding security group d42fd400-718a-4705-ba88-26516eaca3fc to port 85f0f545-6b51-41b2-a9ee-a8c17abc2f57 May 03 21:33:56.442800 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-fbce9609-f876-4bd5-9096-4be3e6dfbe9f tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "POST /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42/action" status: 202 len: 0 microversion: 2.1 time: 0.830156 May 03 21:33:56.443400 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 380/704] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 3 21:33:55 2022] POST /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42/action => generated 0 bytes in 832 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 03 21:33:56.458528 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-c87f8ea1-6d5a-4c0b-9894-6fb1f60813c4 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:56.459268 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-9d6e9483-e68d-4e9a-a8af-72ea95cfda1b req-3b58de96-9fc2-4590-b921-7f89f8af01a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f13ba9d5-9344-4748-8e24-118858bfce42", "tag": "85f0f545-6b51-41b2-a9ee-a8c17abc2f57"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:33:56.459392 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-c87f8ea1-6d5a-4c0b-9894-6fb1f60813c4 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:56.467772 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c87f8ea1-6d5a-4c0b-9894-6fb1f60813c4 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:56.468263 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c87f8ea1-6d5a-4c0b-9894-6fb1f60813c4 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:56.469416 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c87f8ea1-6d5a-4c0b-9894-6fb1f60813c4 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:56.469816 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c87f8ea1-6d5a-4c0b-9894-6fb1f60813c4 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:56.470481 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:33:56.470481 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:33:56.480007 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-9d6e9483-e68d-4e9a-a8af-72ea95cfda1b req-3b58de96-9fc2-4590-b921-7f89f8af01a9 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:56.480548 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-9d6e9483-e68d-4e9a-a8af-72ea95cfda1b req-3b58de96-9fc2-4590-b921-7f89f8af01a9 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:56.656223 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-9d6e9483-e68d-4e9a-a8af-72ea95cfda1b req-3b58de96-9fc2-4590-b921-7f89f8af01a9 service nova] Creating event network-changed:85f0f545-6b51-41b2-a9ee-a8c17abc2f57 for instance f13ba9d5-9344-4748-8e24-118858bfce42 on hv-cinder-84037 May 03 21:33:56.674547 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-9d6e9483-e68d-4e9a-a8af-72ea95cfda1b req-3b58de96-9fc2-4590-b921-7f89f8af01a9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.220885 May 03 21:33:56.674547 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 381/705] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:33:56.682909 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-7bc36ef1-072a-4282-8a49-eb64b71e7d3e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:56.683536 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-7bc36ef1-072a-4282-8a49-eb64b71e7d3e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:56.691776 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7bc36ef1-072a-4282-8a49-eb64b71e7d3e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:56.692220 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7bc36ef1-072a-4282-8a49-eb64b71e7d3e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:56.693040 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7bc36ef1-072a-4282-8a49-eb64b71e7d3e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:56.693471 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7bc36ef1-072a-4282-8a49-eb64b71e7d3e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:56.883297 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-7bc36ef1-072a-4282-8a49-eb64b71e7d3e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:56.908665 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-7bc36ef1-072a-4282-8a49-eb64b71e7d3e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:56.919218 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-7bc36ef1-072a-4282-8a49-eb64b71e7d3e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:56.920712 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-7bc36ef1-072a-4282-8a49-eb64b71e7d3e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1286 microversion: 2.20 time: 0.248764 May 03 21:33:56.922042 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 382/706] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:33:56 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1286 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:33:57.104451 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-c87f8ea1-6d5a-4c0b-9894-6fb1f60813c4 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:57.148865 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-c87f8ea1-6d5a-4c0b-9894-6fb1f60813c4 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1759 microversion: 2.1 time: 0.699475 May 03 21:33:57.168446 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 325/707] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:56 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1759 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:33:57.211901 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-66b85e1b-dd93-4136-9ec4-733e90db021d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:57.217667 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-66b85e1b-dd93-4136-9ec4-733e90db021d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:57.226376 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-66b85e1b-dd93-4136-9ec4-733e90db021d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:57.227087 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-66b85e1b-dd93-4136-9ec4-733e90db021d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:57.228170 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-66b85e1b-dd93-4136-9ec4-733e90db021d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:57.228793 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-66b85e1b-dd93-4136-9ec4-733e90db021d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:57.310111 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-66b85e1b-dd93-4136-9ec4-733e90db021d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.108286 May 03 21:33:57.310683 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 383/708] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 3 21:33:57 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a/os-volume_attachments => generated 25 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 03 21:33:57.438795 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-7509afd6-27fb-4d91-a95a-b33ae67cd52e tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:57.439383 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-7509afd6-27fb-4d91-a95a-b33ae67cd52e tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:57.447894 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7509afd6-27fb-4d91-a95a-b33ae67cd52e tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:57.448323 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7509afd6-27fb-4d91-a95a-b33ae67cd52e tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:57.449155 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7509afd6-27fb-4d91-a95a-b33ae67cd52e tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:57.449586 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7509afd6-27fb-4d91-a95a-b33ae67cd52e tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:57.519620 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-7509afd6-27fb-4d91-a95a-b33ae67cd52e tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Going to try to terminate instance {{(pid=97831) delete /opt/stack/nova/nova/compute/api.py:2559}} May 03 21:33:57.945098 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-267ef5e1-dbe9-46ad-a38c-c3e564dc0e47 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:57.945696 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-267ef5e1-dbe9-46ad-a38c-c3e564dc0e47 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:57.952921 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-267ef5e1-dbe9-46ad-a38c-c3e564dc0e47 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:57.953374 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-267ef5e1-dbe9-46ad-a38c-c3e564dc0e47 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:57.954700 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-267ef5e1-dbe9-46ad-a38c-c3e564dc0e47 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:57.955382 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-267ef5e1-dbe9-46ad-a38c-c3e564dc0e47 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:58.089553 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-7509afd6-27fb-4d91-a95a-b33ae67cd52e tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "DELETE /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 204 len: 0 microversion: 2.1 time: 0.659575 May 03 21:33:58.093309 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 326/709] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 3 21:33:57 2022] DELETE /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 0 bytes in 661 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 03 21:33:58.107008 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-c76a41a5-c7a1-4290-b87c-a7717f00995d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:58.107711 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-c76a41a5-c7a1-4290-b87c-a7717f00995d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:58.108082 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-267ef5e1-dbe9-46ad-a38c-c3e564dc0e47 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:58.115995 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c76a41a5-c7a1-4290-b87c-a7717f00995d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:58.116694 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c76a41a5-c7a1-4290-b87c-a7717f00995d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:58.117998 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c76a41a5-c7a1-4290-b87c-a7717f00995d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:58.118751 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c76a41a5-c7a1-4290-b87c-a7717f00995d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:58.133786 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-267ef5e1-dbe9-46ad-a38c-c3e564dc0e47 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:58.150395 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-267ef5e1-dbe9-46ad-a38c-c3e564dc0e47 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:58.151655 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-267ef5e1-dbe9-46ad-a38c-c3e564dc0e47 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1334 microversion: 2.20 time: 0.216138 May 03 21:33:58.160605 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 384/710] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:33:57 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1334 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:33:58.586120 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-c76a41a5-c7a1-4290-b87c-a7717f00995d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:58.597458 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-c76a41a5-c7a1-4290-b87c-a7717f00995d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1672 microversion: 2.1 time: 0.500499 May 03 21:33:58.598334 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 327/711] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:58 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1672 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:33:59.176197 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-ae702f52-0a89-425b-ae07-ba82846abed8 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:59.176916 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-ae702f52-0a89-425b-ae07-ba82846abed8 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:59.184421 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ae702f52-0a89-425b-ae07-ba82846abed8 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:59.189758 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ae702f52-0a89-425b-ae07-ba82846abed8 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:59.189758 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ae702f52-0a89-425b-ae07-ba82846abed8 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:59.189758 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ae702f52-0a89-425b-ae07-ba82846abed8 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:59.315323 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-ae702f52-0a89-425b-ae07-ba82846abed8 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:59.329676 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-ae702f52-0a89-425b-ae07-ba82846abed8 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:59.341009 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-ae702f52-0a89-425b-ae07-ba82846abed8 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:33:59.343040 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-ae702f52-0a89-425b-ae07-ba82846abed8 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1340 microversion: 2.20 time: 0.175923 May 03 21:33:59.343889 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 385/712] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:33:59 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1340 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:33:59.624340 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-8854c32f-1e75-42aa-b5d6-98417a5a38b7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:33:59.624997 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-8854c32f-1e75-42aa-b5d6-98417a5a38b7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:33:59.633163 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8854c32f-1e75-42aa-b5d6-98417a5a38b7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:59.633605 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8854c32f-1e75-42aa-b5d6-98417a5a38b7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:33:59.634368 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8854c32f-1e75-42aa-b5d6-98417a5a38b7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:33:59.634791 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8854c32f-1e75-42aa-b5d6-98417a5a38b7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:00.093550 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-8854c32f-1e75-42aa-b5d6-98417a5a38b7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:00.102911 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-8854c32f-1e75-42aa-b5d6-98417a5a38b7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1672 microversion: 2.1 time: 0.491025 May 03 21:34:00.103785 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 328/713] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:33:59 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1672 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:00.371263 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-65cc63d4-0c86-468b-b8e6-1c4b3e58e08c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:00.371887 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-65cc63d4-0c86-468b-b8e6-1c4b3e58e08c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:00.379956 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-65cc63d4-0c86-468b-b8e6-1c4b3e58e08c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:00.380404 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-65cc63d4-0c86-468b-b8e6-1c4b3e58e08c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:00.381186 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-65cc63d4-0c86-468b-b8e6-1c4b3e58e08c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:00.381661 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-65cc63d4-0c86-468b-b8e6-1c4b3e58e08c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:00.778927 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-65cc63d4-0c86-468b-b8e6-1c4b3e58e08c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:00.795141 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-65cc63d4-0c86-468b-b8e6-1c4b3e58e08c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:00.808964 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-65cc63d4-0c86-468b-b8e6-1c4b3e58e08c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:00.810180 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-65cc63d4-0c86-468b-b8e6-1c4b3e58e08c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1407 microversion: 2.20 time: 0.452239 May 03 21:34:00.810844 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 386/714] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:34:00 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1407 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:34:01.146040 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-9a3f3766-dbe3-4ee6-8a45-590610d9df4d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:01.151451 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-9a3f3766-dbe3-4ee6-8a45-590610d9df4d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:01.168767 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-efb81c62-552c-4678-ae4d-a78ae4ba6652 req-1a7b3d45-e2c6-4d3c-8f21-0a24dbad8d4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49b86a80-657d-4e94-bc71-bcfe8f276469", "tag": "4a088512-8058-4a9a-a45b-177671d97cfc"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:34:01.169281 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9a3f3766-dbe3-4ee6-8a45-590610d9df4d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:01.169761 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9a3f3766-dbe3-4ee6-8a45-590610d9df4d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:01.171199 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9a3f3766-dbe3-4ee6-8a45-590610d9df4d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:01.171849 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9a3f3766-dbe3-4ee6-8a45-590610d9df4d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:01.182082 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:34:01.182082 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:34:01.192404 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-efb81c62-552c-4678-ae4d-a78ae4ba6652 req-1a7b3d45-e2c6-4d3c-8f21-0a24dbad8d4a service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:01.193290 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-efb81c62-552c-4678-ae4d-a78ae4ba6652 req-1a7b3d45-e2c6-4d3c-8f21-0a24dbad8d4a service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:01.222658 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-efb81c62-552c-4678-ae4d-a78ae4ba6652 req-1a7b3d45-e2c6-4d3c-8f21-0a24dbad8d4a service nova] Creating event network-changed:4a088512-8058-4a9a-a45b-177671d97cfc for instance 49b86a80-657d-4e94-bc71-bcfe8f276469 on hv-cinder-84037 May 03 21:34:01.237782 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-efb81c62-552c-4678-ae4d-a78ae4ba6652 req-1a7b3d45-e2c6-4d3c-8f21-0a24dbad8d4a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181179 May 03 21:34:01.237782 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 329/715] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:34:01.504233 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-9a3f3766-dbe3-4ee6-8a45-590610d9df4d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:01.512579 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-9a3f3766-dbe3-4ee6-8a45-590610d9df4d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1672 microversion: 2.1 time: 0.393378 May 03 21:34:01.513141 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 387/716] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:01 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1672 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:01.835711 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-a52ee04f-fdd4-4bcb-b77a-da277519cb9e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:01.836703 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-a52ee04f-fdd4-4bcb-b77a-da277519cb9e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:01.846439 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a52ee04f-fdd4-4bcb-b77a-da277519cb9e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:01.855800 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a52ee04f-fdd4-4bcb-b77a-da277519cb9e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:01.855800 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a52ee04f-fdd4-4bcb-b77a-da277519cb9e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:01.855800 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a52ee04f-fdd4-4bcb-b77a-da277519cb9e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:02.543361 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-25cd9fe9-1246-4e64-a14e-1615dde0bd08 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:02.544950 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-25cd9fe9-1246-4e64-a14e-1615dde0bd08 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:02.553763 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-25cd9fe9-1246-4e64-a14e-1615dde0bd08 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:02.557392 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-25cd9fe9-1246-4e64-a14e-1615dde0bd08 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:02.557392 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-25cd9fe9-1246-4e64-a14e-1615dde0bd08 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:02.557392 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-25cd9fe9-1246-4e64-a14e-1615dde0bd08 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:02.583623 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-a52ee04f-fdd4-4bcb-b77a-da277519cb9e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:02.605356 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-a52ee04f-fdd4-4bcb-b77a-da277519cb9e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:02.613970 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-a52ee04f-fdd4-4bcb-b77a-da277519cb9e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:02.616740 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-a52ee04f-fdd4-4bcb-b77a-da277519cb9e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1407 microversion: 2.20 time: 0.791091 May 03 21:34:02.616740 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 330/717] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:34:01 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1407 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:34:02.721839 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-25cd9fe9-1246-4e64-a14e-1615dde0bd08 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:02.738250 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-25cd9fe9-1246-4e64-a14e-1615dde0bd08 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1604 microversion: 2.1 time: 0.208779 May 03 21:34:02.753096 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 388/718] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:02 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1604 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:03.592212 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-cdba7e97-14f0-4914-820e-beb1512efa30 req-f726c171-f895-4080-af50-b849eaae86e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "274fd6f3-1f2e-4da8-8c5f-fa173514fc2a", "name": "network-vif-deleted", "tag": "46d7aa18-8157-45ea-b292-6af9e591723f"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:34:03.601430 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:34:03.601430 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:34:03.629619 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-cdba7e97-14f0-4914-820e-beb1512efa30 req-f726c171-f895-4080-af50-b849eaae86e3 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:03.629619 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-cdba7e97-14f0-4914-820e-beb1512efa30 req-f726c171-f895-4080-af50-b849eaae86e3 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:03.641664 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-93dad814-2bc2-49b8-870b-31044123c8f9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:03.642854 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-93dad814-2bc2-49b8-870b-31044123c8f9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:03.643826 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-cdba7e97-14f0-4914-820e-beb1512efa30 req-f726c171-f895-4080-af50-b849eaae86e3 service nova] Creating event network-vif-deleted:46d7aa18-8157-45ea-b292-6af9e591723f for instance 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a on hv-cinder-84037 May 03 21:34:03.649609 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-cdba7e97-14f0-4914-820e-beb1512efa30 req-f726c171-f895-4080-af50-b849eaae86e3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066598 May 03 21:34:03.650957 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 331/719] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:34:03.651834 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-93dad814-2bc2-49b8-870b-31044123c8f9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:03.652289 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-93dad814-2bc2-49b8-870b-31044123c8f9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:03.653159 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-93dad814-2bc2-49b8-870b-31044123c8f9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:03.653773 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-93dad814-2bc2-49b8-870b-31044123c8f9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:03.803105 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-32eb5a4b-a3d5-4efb-a025-2968331e5254 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:03.803105 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-32eb5a4b-a3d5-4efb-a025-2968331e5254 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:03.812938 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-32eb5a4b-a3d5-4efb-a025-2968331e5254 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:03.814425 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-32eb5a4b-a3d5-4efb-a025-2968331e5254 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:03.815530 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-32eb5a4b-a3d5-4efb-a025-2968331e5254 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:03.816508 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-32eb5a4b-a3d5-4efb-a025-2968331e5254 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:04.050407 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-93dad814-2bc2-49b8-870b-31044123c8f9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:04.090818 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-93dad814-2bc2-49b8-870b-31044123c8f9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:04.129250 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-93dad814-2bc2-49b8-870b-31044123c8f9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:04.135215 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-93dad814-2bc2-49b8-870b-31044123c8f9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1407 microversion: 2.20 time: 0.503848 May 03 21:34:04.138646 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 389/720] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:34:03 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1407 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:34:04.298099 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-32eb5a4b-a3d5-4efb-a025-2968331e5254 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:04.306541 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-32eb5a4b-a3d5-4efb-a025-2968331e5254 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 200 len: 1321 microversion: 2.1 time: 0.529837 May 03 21:34:04.314656 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 332/721] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:03 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 1321 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:34:05.165110 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-8e61050a-58d2-4feb-ad72-19ef2c3da9cc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:05.174367 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-8e61050a-58d2-4feb-ad72-19ef2c3da9cc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:05.187478 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8e61050a-58d2-4feb-ad72-19ef2c3da9cc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:05.188775 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8e61050a-58d2-4feb-ad72-19ef2c3da9cc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:05.190112 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8e61050a-58d2-4feb-ad72-19ef2c3da9cc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:05.190716 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8e61050a-58d2-4feb-ad72-19ef2c3da9cc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:05.331209 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-d3d8a52b-a27d-4790-9a51-42fa17d6dc44 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:05.331812 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-d3d8a52b-a27d-4790-9a51-42fa17d6dc44 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:05.339938 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d3d8a52b-a27d-4790-9a51-42fa17d6dc44 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:05.340734 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d3d8a52b-a27d-4790-9a51-42fa17d6dc44 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:05.341524 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d3d8a52b-a27d-4790-9a51-42fa17d6dc44 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:05.342168 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d3d8a52b-a27d-4790-9a51-42fa17d6dc44 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:05.401704 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.wsgi [None req-d3d8a52b-a27d-4790-9a51-42fa17d6dc44 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] HTTP exception thrown: Instance 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a could not be found. May 03 21:34:05.402624 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-d3d8a52b-a27d-4790-9a51-42fa17d6dc44 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Returning 404 to user: Instance 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a could not be found. {{(pid=97831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:34:05.403632 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-d3d8a52b-a27d-4790-9a51-42fa17d6dc44 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 404 len: 111 microversion: 2.1 time: 0.083306 May 03 21:34:05.404762 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 333/722] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:05 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 03 21:34:05.421273 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-140cc746-7401-4a9d-95c7-4b5851dce154 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '.version_select at 0x7fc84cc62dc0>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:05.444955 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-8e61050a-58d2-4feb-ad72-19ef2c3da9cc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:05.459871 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-8e61050a-58d2-4feb-ad72-19ef2c3da9cc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:05.466456 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-8e61050a-58d2-4feb-ad72-19ef2c3da9cc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:05.467665 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-8e61050a-58d2-4feb-ad72-19ef2c3da9cc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1407 microversion: 2.20 time: 0.316268 May 03 21:34:05.468089 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 390/723] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:34:05 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1407 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 21:34:05.566760 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-140cc746-7401-4a9d-95c7-4b5851dce154 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-446845386" status: 202 len: 0 microversion: 2.1 time: 0.154855 May 03 21:34:05.566760 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 334/724] 10.222.0.48 () {58 vars in 1217 bytes} [Tue May 3 21:34:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-446845386 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 21:34:06.493057 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-e1235396-aa8a-459f-a070-b6486b39bff5 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:06.493939 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-e1235396-aa8a-459f-a070-b6486b39bff5 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:06.503658 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e1235396-aa8a-459f-a070-b6486b39bff5 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:06.504407 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e1235396-aa8a-459f-a070-b6486b39bff5 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:06.505754 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e1235396-aa8a-459f-a070-b6486b39bff5 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:06.506456 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e1235396-aa8a-459f-a070-b6486b39bff5 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:06.935115 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-e1235396-aa8a-459f-a070-b6486b39bff5 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:06.966986 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-e1235396-aa8a-459f-a070-b6486b39bff5 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:06.978778 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-e1235396-aa8a-459f-a070-b6486b39bff5 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:06.980993 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-e1235396-aa8a-459f-a070-b6486b39bff5 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1407 microversion: 2.20 time: 0.497917 May 03 21:34:06.981556 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 391/725] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:34:06 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1407 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:34:07.397381 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-bb4ce192-86d5-4ab3-b135-a23125a2139d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Action: 'create', calling method: .version_select at 0x7fc84cc269d0>, body: {"keypair": {"name": "tempest-keypair-1141467559"}} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:34:07.431034 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-bb4ce192-86d5-4ab3-b135-a23125a2139d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Getting quotas for project a2df1ca790224a009004c3c22a5ee5c5. Resources: {'key_pairs'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:34:07.435074 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-bb4ce192-86d5-4ab3-b135-a23125a2139d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Getting quotas for user 649d5374c0ae4842853cd3b425d1d6d2 and project a2df1ca790224a009004c3c22a5ee5c5. Resources: {'key_pairs'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:34:07.622097 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-bb4ce192-86d5-4ab3-b135-a23125a2139d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Getting quotas for project a2df1ca790224a009004c3c22a5ee5c5. Resources: {'key_pairs'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:34:07.628404 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-bb4ce192-86d5-4ab3-b135-a23125a2139d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Getting quotas for user 649d5374c0ae4842853cd3b425d1d6d2 and project a2df1ca790224a009004c3c22a5ee5c5. Resources: {'key_pairs'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:34:07.656421 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-bb4ce192-86d5-4ab3-b135-a23125a2139d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.269674 May 03 21:34:07.657830 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 335/726] 10.222.0.48 () {60 vars in 1157 bytes} [Tue May 3 21:34:07 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:08.009763 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-7c745f55-c8ce-4536-a4f7-979a6e160a36 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:08.010608 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-7c745f55-c8ce-4536-a4f7-979a6e160a36 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:08.021787 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7c745f55-c8ce-4536-a4f7-979a6e160a36 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:08.022983 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7c745f55-c8ce-4536-a4f7-979a6e160a36 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:08.023895 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7c745f55-c8ce-4536-a4f7-979a6e160a36 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:08.024414 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7c745f55-c8ce-4536-a4f7-979a6e160a36 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:08.287286 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-7c745f55-c8ce-4536-a4f7-979a6e160a36 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:08.300808 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-7c745f55-c8ce-4536-a4f7-979a6e160a36 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:08.306943 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-7c745f55-c8ce-4536-a4f7-979a6e160a36 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:08.308065 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-7c745f55-c8ce-4536-a4f7-979a6e160a36 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1407 microversion: 2.20 time: 0.310126 May 03 21:34:08.308625 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 392/727] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:34:07 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1407 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 21:34:09.332626 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-2425cf7b-69b6-49b9-911b-09768fbb9d6e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:09.333869 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-2425cf7b-69b6-49b9-911b-09768fbb9d6e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:09.342024 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2425cf7b-69b6-49b9-911b-09768fbb9d6e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:09.342587 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2425cf7b-69b6-49b9-911b-09768fbb9d6e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:09.343473 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2425cf7b-69b6-49b9-911b-09768fbb9d6e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:09.343967 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2425cf7b-69b6-49b9-911b-09768fbb9d6e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:09.793701 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-2425cf7b-69b6-49b9-911b-09768fbb9d6e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:09.807825 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-2425cf7b-69b6-49b9-911b-09768fbb9d6e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:09.814268 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-2425cf7b-69b6-49b9-911b-09768fbb9d6e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:09.815354 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-2425cf7b-69b6-49b9-911b-09768fbb9d6e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1407 microversion: 2.20 time: 0.493350 May 03 21:34:09.815887 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 336/728] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:34:09 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1407 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:34:10.839632 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-de63ddfe-6ceb-4916-9532-e530533a0cb4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:10.840246 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-de63ddfe-6ceb-4916-9532-e530533a0cb4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:10.849418 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-de63ddfe-6ceb-4916-9532-e530533a0cb4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:10.849850 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-de63ddfe-6ceb-4916-9532-e530533a0cb4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:10.850759 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-de63ddfe-6ceb-4916-9532-e530533a0cb4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:10.851279 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-de63ddfe-6ceb-4916-9532-e530533a0cb4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:11.182835 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-de63ddfe-6ceb-4916-9532-e530533a0cb4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:11.198184 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-de63ddfe-6ceb-4916-9532-e530533a0cb4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:11.206039 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-de63ddfe-6ceb-4916-9532-e530533a0cb4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:11.207603 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-de63ddfe-6ceb-4916-9532-e530533a0cb4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1407 microversion: 2.20 time: 0.377089 May 03 21:34:11.207814 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 393/729] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:34:10 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1407 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:34:11.275762 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-352a7f35-47c6-46a6-94b7-dfd205e5d69d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-885085461", "imageRef": "f5214328-64f1-4aa6-aa05-61f0189e0e1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "74dacc7e-115e-4cd0-87fd-8eaa4de43b7c"}], "security_groups": [{"name": "tempest-securitygroup--576574764"}], "key_name": "tempest-keypair-1141467559", "user_data": "}} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:34:11.639047 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.network.neutron [None req-352a7f35-47c6-46a6-94b7-dfd205e5d69d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] validate_networks() for [('74dacc7e-115e-4cd0-87fd-8eaa4de43b7c', None, None, None)] {{(pid=97831) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} May 03 21:34:12.247659 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-bb65388c-d0f6-4547-b379-a772a19699f7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:12.248831 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-bb65388c-d0f6-4547-b379-a772a19699f7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:12.281887 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-bb65388c-d0f6-4547-b379-a772a19699f7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:12.282362 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-bb65388c-d0f6-4547-b379-a772a19699f7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:12.283175 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-bb65388c-d0f6-4547-b379-a772a19699f7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:12.283714 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-bb65388c-d0f6-4547-b379-a772a19699f7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:12.402675 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-352a7f35-47c6-46a6-94b7-dfd205e5d69d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Flavor limits 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} May 03 21:34:12.403199 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-352a7f35-47c6-46a6-94b7-dfd205e5d69d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Image limits 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} May 03 21:34:12.403737 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-352a7f35-47c6-46a6-94b7-dfd205e5d69d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Flavor pref 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} May 03 21:34:12.404413 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-352a7f35-47c6-46a6-94b7-dfd205e5d69d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Image pref 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} May 03 21:34:12.404920 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-352a7f35-47c6-46a6-94b7-dfd205e5d69d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} May 03 21:34:12.419554 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-352a7f35-47c6-46a6-94b7-dfd205e5d69d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:12.420361 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-352a7f35-47c6-46a6-94b7-dfd205e5d69d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:12.421371 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-352a7f35-47c6-46a6-94b7-dfd205e5d69d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:12.422041 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-352a7f35-47c6-46a6-94b7-dfd205e5d69d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:12.449844 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-352a7f35-47c6-46a6-94b7-dfd205e5d69d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Getting quotas for project a2df1ca790224a009004c3c22a5ee5c5. Resources: {'instances', 'ram', 'cores'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:34:12.464630 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-352a7f35-47c6-46a6-94b7-dfd205e5d69d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Getting quotas for user 649d5374c0ae4842853cd3b425d1d6d2 and project a2df1ca790224a009004c3c22a5ee5c5. Resources: {'instances', 'ram', 'cores'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:34:12.476653 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-352a7f35-47c6-46a6-94b7-dfd205e5d69d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Going to run 1 instances... {{(pid=97831) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} May 03 21:34:12.479403 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-352a7f35-47c6-46a6-94b7-dfd205e5d69d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5214328-64f1-4aa6-aa05-61f0189e0e1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=97831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} May 03 21:34:12.543137 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-bb65388c-d0f6-4547-b379-a772a19699f7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:12.557600 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-bb65388c-d0f6-4547-b379-a772a19699f7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:12.563925 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-bb65388c-d0f6-4547-b379-a772a19699f7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:12.565027 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-bb65388c-d0f6-4547-b379-a772a19699f7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1407 microversion: 2.20 time: 0.343014 May 03 21:34:12.565561 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 394/730] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:34:12 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1407 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:34:12.696522 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-352a7f35-47c6-46a6-94b7-dfd205e5d69d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.431106 May 03 21:34:12.697167 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 337/731] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 3 21:34:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 1433 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 03 21:34:12.714610 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-b7d86834-29e1-4d68-bc04-0e69c1b1ee7b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:12.715286 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-b7d86834-29e1-4d68-bc04-0e69c1b1ee7b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:13.030189 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-b7d86834-29e1-4d68-bc04-0e69c1b1ee7b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:13.040161 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-b7d86834-29e1-4d68-bc04-0e69c1b1ee7b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87" status: 200 len: 1237 microversion: 2.1 time: 0.336496 May 03 21:34:13.041397 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 395/732] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:12 2022] GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87 => generated 1237 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:13.592022 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-135562d3-8599-47a5-b900-864181655914 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:13.600510 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-135562d3-8599-47a5-b900-864181655914 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:13.619146 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-135562d3-8599-47a5-b900-864181655914 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:13.620203 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-135562d3-8599-47a5-b900-864181655914 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:13.621837 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-135562d3-8599-47a5-b900-864181655914 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:13.623101 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-135562d3-8599-47a5-b900-864181655914 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:13.794064 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-320479dc-55e8-4248-82b2-9ed7f9c34ec1 req-76979fac-d182-408d-bc59-d8cb357956da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49b86a80-657d-4e94-bc71-bcfe8f276469", "name": "network-vif-plugged", "status": "completed", "tag": "4a088512-8058-4a9a-a45b-177671d97cfc"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:34:13.801828 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:34:13.801828 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:34:13.814939 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-320479dc-55e8-4248-82b2-9ed7f9c34ec1 req-76979fac-d182-408d-bc59-d8cb357956da service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:13.815801 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-320479dc-55e8-4248-82b2-9ed7f9c34ec1 req-76979fac-d182-408d-bc59-d8cb357956da service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:13.848878 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-320479dc-55e8-4248-82b2-9ed7f9c34ec1 req-76979fac-d182-408d-bc59-d8cb357956da service nova] Creating event network-vif-plugged:4a088512-8058-4a9a-a45b-177671d97cfc for instance 49b86a80-657d-4e94-bc71-bcfe8f276469 on hv-cinder-84037 May 03 21:34:13.854944 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-320479dc-55e8-4248-82b2-9ed7f9c34ec1 req-76979fac-d182-408d-bc59-d8cb357956da service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.265265 May 03 21:34:13.858939 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 396/733] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:34:13.982759 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-135562d3-8599-47a5-b900-864181655914 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:13.999313 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-135562d3-8599-47a5-b900-864181655914 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:14.024251 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-135562d3-8599-47a5-b900-864181655914 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:14.027914 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-135562d3-8599-47a5-b900-864181655914 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1407 microversion: 2.20 time: 0.444848 May 03 21:34:14.029016 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 338/734] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:34:13 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1407 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:34:14.071427 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-7236df1d-6f3d-4dea-897f-ef45db3e5f82 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:14.074759 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-7236df1d-6f3d-4dea-897f-ef45db3e5f82 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:14.089882 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7236df1d-6f3d-4dea-897f-ef45db3e5f82 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:14.090549 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7236df1d-6f3d-4dea-897f-ef45db3e5f82 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:14.091487 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7236df1d-6f3d-4dea-897f-ef45db3e5f82 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:14.092074 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7236df1d-6f3d-4dea-897f-ef45db3e5f82 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:14.255031 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-7236df1d-6f3d-4dea-897f-ef45db3e5f82 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:14.264161 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-7236df1d-6f3d-4dea-897f-ef45db3e5f82 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87" status: 200 len: 1241 microversion: 2.1 time: 0.208994 May 03 21:34:14.264950 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 397/735] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:14 2022] GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87 => generated 1241 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:14.432057 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-4e8b2adb-9552-45e8-bfe0-73b3f846e5ec tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:14.432585 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-4e8b2adb-9552-45e8-bfe0-73b3f846e5ec tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:14.440905 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4e8b2adb-9552-45e8-bfe0-73b3f846e5ec tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:14.441359 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4e8b2adb-9552-45e8-bfe0-73b3f846e5ec tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:14.442142 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4e8b2adb-9552-45e8-bfe0-73b3f846e5ec tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:14.442581 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4e8b2adb-9552-45e8-bfe0-73b3f846e5ec tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:14.942936 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-4e8b2adb-9552-45e8-bfe0-73b3f846e5ec tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52/os-volume_attachments/c9b7a540-3b03-4517-9746-6799e6107dba" status: 202 len: 0 microversion: 2.1 time: 0.519767 May 03 21:34:14.943680 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 339/736] 10.222.0.48 () {58 vars in 1415 bytes} [Tue May 3 21:34:14 2022] DELETE /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52/os-volume_attachments/c9b7a540-3b03-4517-9746-6799e6107dba => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 21:34:14.959141 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-86ba8fda-30c5-4c86-b26a-be483d53600d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:14.967418 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-86ba8fda-30c5-4c86-b26a-be483d53600d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:14.967965 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-86ba8fda-30c5-4c86-b26a-be483d53600d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:14.968653 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-86ba8fda-30c5-4c86-b26a-be483d53600d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:14.969506 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-86ba8fda-30c5-4c86-b26a-be483d53600d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:14.969987 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-86ba8fda-30c5-4c86-b26a-be483d53600d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:15.053175 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-566255d8-02c9-41d7-acae-d587b44dd33d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:15.054122 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-566255d8-02c9-41d7-acae-d587b44dd33d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:15.062205 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-566255d8-02c9-41d7-acae-d587b44dd33d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:15.062653 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-566255d8-02c9-41d7-acae-d587b44dd33d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:15.064359 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-566255d8-02c9-41d7-acae-d587b44dd33d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:15.064975 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-566255d8-02c9-41d7-acae-d587b44dd33d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:15.103984 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-86ba8fda-30c5-4c86-b26a-be483d53600d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155029 May 03 21:34:15.105752 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 398/737] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 3 21:34:14 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:34:15.287774 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-412c556f-8894-4857-865d-bded0499f6b4 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:15.288495 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-412c556f-8894-4857-865d-bded0499f6b4 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:15.295996 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-412c556f-8894-4857-865d-bded0499f6b4 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:15.296828 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-412c556f-8894-4857-865d-bded0499f6b4 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:15.298125 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-412c556f-8894-4857-865d-bded0499f6b4 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:15.298772 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-412c556f-8894-4857-865d-bded0499f6b4 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:15.300602 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-566255d8-02c9-41d7-acae-d587b44dd33d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:15.315049 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-566255d8-02c9-41d7-acae-d587b44dd33d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:15.321762 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-566255d8-02c9-41d7-acae-d587b44dd33d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:15.322777 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-566255d8-02c9-41d7-acae-d587b44dd33d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1407 microversion: 2.20 time: 0.279871 May 03 21:34:15.334323 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 340/738] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:34:15 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1407 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:34:15.452157 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-412c556f-8894-4857-865d-bded0499f6b4 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:15.463834 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-412c556f-8894-4857-865d-bded0499f6b4 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87" status: 200 len: 1241 microversion: 2.1 time: 0.185884 May 03 21:34:15.464404 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 399/739] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:15 2022] GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87 => generated 1241 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:34:16.133922 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-a7b558b8-cfb5-4585-972d-1bf686f5642d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:16.134951 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-a7b558b8-cfb5-4585-972d-1bf686f5642d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:16.146238 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a7b558b8-cfb5-4585-972d-1bf686f5642d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:16.146694 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a7b558b8-cfb5-4585-972d-1bf686f5642d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:16.147490 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a7b558b8-cfb5-4585-972d-1bf686f5642d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:16.147932 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a7b558b8-cfb5-4585-972d-1bf686f5642d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:16.307148 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-a7b558b8-cfb5-4585-972d-1bf686f5642d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.193419 May 03 21:34:16.308328 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 341/740] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 3 21:34:16 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:34:16.351764 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-e57e0346-4785-448f-815c-6c1af1b59c65 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:16.352824 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-e57e0346-4785-448f-815c-6c1af1b59c65 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:16.360733 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e57e0346-4785-448f-815c-6c1af1b59c65 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:16.361190 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e57e0346-4785-448f-815c-6c1af1b59c65 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:16.362009 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e57e0346-4785-448f-815c-6c1af1b59c65 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:16.362484 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e57e0346-4785-448f-815c-6c1af1b59c65 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:16.486840 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-ffddaacf-fabe-43bb-a226-c679560e535b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:16.487855 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-ffddaacf-fabe-43bb-a226-c679560e535b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:16.499276 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ffddaacf-fabe-43bb-a226-c679560e535b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:16.499276 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ffddaacf-fabe-43bb-a226-c679560e535b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:16.499276 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ffddaacf-fabe-43bb-a226-c679560e535b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:16.500921 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ffddaacf-fabe-43bb-a226-c679560e535b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:16.698917 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-ffddaacf-fabe-43bb-a226-c679560e535b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:16.716315 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-ffddaacf-fabe-43bb-a226-c679560e535b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87" status: 200 len: 1233 microversion: 2.1 time: 0.237837 May 03 21:34:16.727238 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 342/741] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:16 2022] GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87 => generated 1233 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:34:16.808730 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-e57e0346-4785-448f-815c-6c1af1b59c65 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:16.822749 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-e57e0346-4785-448f-815c-6c1af1b59c65 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:16.830783 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-e57e0346-4785-448f-815c-6c1af1b59c65 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:16.831874 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-e57e0346-4785-448f-815c-6c1af1b59c65 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1407 microversion: 2.20 time: 0.492296 May 03 21:34:16.832408 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 400/742] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:34:16 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1407 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 21:34:17.329297 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-32eb7302-d374-4430-9b7f-0a31e19794b3 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:17.331525 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-32eb7302-d374-4430-9b7f-0a31e19794b3 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:17.351717 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-32eb7302-d374-4430-9b7f-0a31e19794b3 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:17.353047 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-32eb7302-d374-4430-9b7f-0a31e19794b3 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:17.354187 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-32eb7302-d374-4430-9b7f-0a31e19794b3 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:17.354805 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-32eb7302-d374-4430-9b7f-0a31e19794b3 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:17.440266 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-32eb7302-d374-4430-9b7f-0a31e19794b3 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123858 May 03 21:34:17.441268 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 343/743] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 3 21:34:17 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:34:17.741555 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-4898b063-763f-4632-a05b-48b5dbbafb96 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:17.742183 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-4898b063-763f-4632-a05b-48b5dbbafb96 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:17.750673 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4898b063-763f-4632-a05b-48b5dbbafb96 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:17.757470 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4898b063-763f-4632-a05b-48b5dbbafb96 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:17.757470 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4898b063-763f-4632-a05b-48b5dbbafb96 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:17.757470 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4898b063-763f-4632-a05b-48b5dbbafb96 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:17.874286 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-1ce56da2-8f0a-459b-acfa-fb45d3466f35 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:17.874912 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-1ce56da2-8f0a-459b-acfa-fb45d3466f35 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:17.884876 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1ce56da2-8f0a-459b-acfa-fb45d3466f35 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:17.884876 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1ce56da2-8f0a-459b-acfa-fb45d3466f35 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:17.886003 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1ce56da2-8f0a-459b-acfa-fb45d3466f35 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:17.886444 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1ce56da2-8f0a-459b-acfa-fb45d3466f35 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:18.043207 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-4898b063-763f-4632-a05b-48b5dbbafb96 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:18.061330 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-4898b063-763f-4632-a05b-48b5dbbafb96 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87" status: 200 len: 1289 microversion: 2.1 time: 0.330213 May 03 21:34:18.076597 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 401/744] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:17 2022] GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87 => generated 1289 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:18.460055 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-be7840cd-3cad-4582-b0b5-79d4ea1a9c97 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:18.461233 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-be7840cd-3cad-4582-b0b5-79d4ea1a9c97 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:18.470646 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-be7840cd-3cad-4582-b0b5-79d4ea1a9c97 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:18.471577 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-be7840cd-3cad-4582-b0b5-79d4ea1a9c97 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:18.478396 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-be7840cd-3cad-4582-b0b5-79d4ea1a9c97 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:18.479372 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-be7840cd-3cad-4582-b0b5-79d4ea1a9c97 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:18.632585 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-be7840cd-3cad-4582-b0b5-79d4ea1a9c97 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.182738 May 03 21:34:18.656930 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 402/745] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 3 21:34:18 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52/os-volume_attachments => generated 197 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:34:18.669103 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-1ce56da2-8f0a-459b-acfa-fb45d3466f35 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:18.688692 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-1ce56da2-8f0a-459b-acfa-fb45d3466f35 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:18.696661 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-1ce56da2-8f0a-459b-acfa-fb45d3466f35 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:18.698148 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-1ce56da2-8f0a-459b-acfa-fb45d3466f35 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1407 microversion: 2.20 time: 0.836946 May 03 21:34:18.698922 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 344/746] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:34:17 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1407 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:34:19.096330 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-047ee541-ae23-49f9-86e1-e3b9d5778660 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:19.097154 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-047ee541-ae23-49f9-86e1-e3b9d5778660 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:19.113347 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-047ee541-ae23-49f9-86e1-e3b9d5778660 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:19.115683 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-047ee541-ae23-49f9-86e1-e3b9d5778660 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:19.116587 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-047ee541-ae23-49f9-86e1-e3b9d5778660 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:19.117030 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-047ee541-ae23-49f9-86e1-e3b9d5778660 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:19.332288 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-047ee541-ae23-49f9-86e1-e3b9d5778660 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:19.340949 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-047ee541-ae23-49f9-86e1-e3b9d5778660 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87" status: 200 len: 1295 microversion: 2.1 time: 0.258975 May 03 21:34:19.341505 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 403/747] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:19 2022] GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87 => generated 1295 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:34:19.661011 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-b5112430-4a9b-4a8a-835b-cc1fa5dbe0e4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:19.661855 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-b5112430-4a9b-4a8a-835b-cc1fa5dbe0e4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:19.671550 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b5112430-4a9b-4a8a-835b-cc1fa5dbe0e4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:19.672258 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b5112430-4a9b-4a8a-835b-cc1fa5dbe0e4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:19.672863 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b5112430-4a9b-4a8a-835b-cc1fa5dbe0e4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:19.673447 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b5112430-4a9b-4a8a-835b-cc1fa5dbe0e4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:19.730204 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-807191ad-4548-4a57-9444-1899c81d2f4d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:19.730838 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-807191ad-4548-4a57-9444-1899c81d2f4d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:19.755906 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-807191ad-4548-4a57-9444-1899c81d2f4d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:19.756653 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-807191ad-4548-4a57-9444-1899c81d2f4d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:19.757909 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-807191ad-4548-4a57-9444-1899c81d2f4d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:19.758356 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-807191ad-4548-4a57-9444-1899c81d2f4d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:19.767721 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-b5112430-4a9b-4a8a-835b-cc1fa5dbe0e4 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121483 May 03 21:34:19.772827 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 345/748] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 3 21:34:19 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:34:19.787018 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-4980d9a8-d1ea-48d6-b994-d00c33034c15 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:34:19.788031 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-4980d9a8-d1ea-48d6-b994-d00c33034c15 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:19.802719 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4980d9a8-d1ea-48d6-b994-d00c33034c15 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:19.803460 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4980d9a8-d1ea-48d6-b994-d00c33034c15 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:19.804814 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4980d9a8-d1ea-48d6-b994-d00c33034c15 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:19.815844 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4980d9a8-d1ea-48d6-b994-d00c33034c15 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:20.076619 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-807191ad-4548-4a57-9444-1899c81d2f4d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:20.093286 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-807191ad-4548-4a57-9444-1899c81d2f4d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:20.105841 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-807191ad-4548-4a57-9444-1899c81d2f4d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:20.111426 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-807191ad-4548-4a57-9444-1899c81d2f4d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1599 microversion: 2.20 time: 0.395561 May 03 21:34:20.111426 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 404/749] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:34:19 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1599 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 21:34:20.169103 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-d4b53699-2b8b-4f8d-ab5e-1658f4db44c3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:20.169103 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-d4b53699-2b8b-4f8d-ab5e-1658f4db44c3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:20.175594 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d4b53699-2b8b-4f8d-ab5e-1658f4db44c3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:20.176315 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d4b53699-2b8b-4f8d-ab5e-1658f4db44c3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:20.177454 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d4b53699-2b8b-4f8d-ab5e-1658f4db44c3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:20.178157 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d4b53699-2b8b-4f8d-ab5e-1658f4db44c3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:20.351357 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-d4b53699-2b8b-4f8d-ab5e-1658f4db44c3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.214496 May 03 21:34:20.356020 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 405/750] 10.222.0.48 () {60 vars in 1315 bytes} [Tue May 3 21:34:20 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469/os-interface => generated 284 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 21:34:20.372669 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-39ed3ff7-48dc-47d0-93da-b798ba292904 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:20.373630 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-39ed3ff7-48dc-47d0-93da-b798ba292904 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:20.382198 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-39ed3ff7-48dc-47d0-93da-b798ba292904 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:20.383425 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-39ed3ff7-48dc-47d0-93da-b798ba292904 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:20.384331 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-39ed3ff7-48dc-47d0-93da-b798ba292904 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:20.384877 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-39ed3ff7-48dc-47d0-93da-b798ba292904 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:20.408341 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-4980d9a8-d1ea-48d6-b994-d00c33034c15 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "POST /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42/action" status: 202 len: 0 microversion: 2.1 time: 0.634105 May 03 21:34:20.409185 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 346/751] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 3 21:34:19 2022] POST /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42/action => generated 0 bytes in 636 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 21:34:20.446381 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-1250b3e1-a6a0-469b-8ae3-c3ce59490888 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:20.447611 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-1250b3e1-a6a0-469b-8ae3-c3ce59490888 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:20.469763 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1250b3e1-a6a0-469b-8ae3-c3ce59490888 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:20.470313 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1250b3e1-a6a0-469b-8ae3-c3ce59490888 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:20.471199 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1250b3e1-a6a0-469b-8ae3-c3ce59490888 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:20.471715 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1250b3e1-a6a0-469b-8ae3-c3ce59490888 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:21.090599 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-39ed3ff7-48dc-47d0-93da-b798ba292904 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:21.106543 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-39ed3ff7-48dc-47d0-93da-b798ba292904 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87" status: 200 len: 1362 microversion: 2.1 time: 0.744520 May 03 21:34:21.108278 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-1250b3e1-a6a0-469b-8ae3-c3ce59490888 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:21.128641 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 406/752] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:20 2022] GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87 => generated 1362 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:21.134332 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-1250b3e1-a6a0-469b-8ae3-c3ce59490888 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1751 microversion: 2.1 time: 0.720700 May 03 21:34:21.143759 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-f80996d2-baf8-4625-b7de-9c361cdabd7d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:21.143985 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-f80996d2-baf8-4625-b7de-9c361cdabd7d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:21.145318 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 347/753] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:20 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1751 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:21.152019 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f80996d2-baf8-4625-b7de-9c361cdabd7d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:21.153100 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f80996d2-baf8-4625-b7de-9c361cdabd7d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:21.153292 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f80996d2-baf8-4625-b7de-9c361cdabd7d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:21.153708 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f80996d2-baf8-4625-b7de-9c361cdabd7d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:21.250998 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-f80996d2-baf8-4625-b7de-9c361cdabd7d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120330 May 03 21:34:21.252120 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 407/754] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 3 21:34:21 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:34:22.144338 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-a3c783c4-f183-4867-921c-12dbc16f83e7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:22.146227 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-a3c783c4-f183-4867-921c-12dbc16f83e7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:22.162764 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a3c783c4-f183-4867-921c-12dbc16f83e7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:22.172100 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-03481d16-831e-4ec7-baa4-d5f669699b3a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:22.172979 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a3c783c4-f183-4867-921c-12dbc16f83e7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:22.173338 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-03481d16-831e-4ec7-baa4-d5f669699b3a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:22.173690 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a3c783c4-f183-4867-921c-12dbc16f83e7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:22.173690 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a3c783c4-f183-4867-921c-12dbc16f83e7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:22.181905 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-03481d16-831e-4ec7-baa4-d5f669699b3a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:22.182360 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-03481d16-831e-4ec7-baa4-d5f669699b3a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:22.183159 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-03481d16-831e-4ec7-baa4-d5f669699b3a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:22.183596 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-03481d16-831e-4ec7-baa4-d5f669699b3a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:22.713229 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-03481d16-831e-4ec7-baa4-d5f669699b3a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:22.737635 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-03481d16-831e-4ec7-baa4-d5f669699b3a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1751 microversion: 2.1 time: 0.583425 May 03 21:34:22.739879 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 408/755] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:22 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1751 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:22.773590 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-277ba88a-4c19-4e81-b448-f99e569fb397 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:22.773590 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-277ba88a-4c19-4e81-b448-f99e569fb397 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:22.789865 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-277ba88a-4c19-4e81-b448-f99e569fb397 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:22.792215 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-277ba88a-4c19-4e81-b448-f99e569fb397 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:22.794146 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-277ba88a-4c19-4e81-b448-f99e569fb397 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:22.795347 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-277ba88a-4c19-4e81-b448-f99e569fb397 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:22.920719 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-277ba88a-4c19-4e81-b448-f99e569fb397 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.177907 May 03 21:34:22.922784 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 409/756] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 3 21:34:22 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:34:22.933164 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-a3c783c4-f183-4867-921c-12dbc16f83e7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:22.933419 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-c20ff16d-5c6d-46c3-bfbb-ca36261b7a7f req-89bfb79e-8395-4458-a71e-222d436a576b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aab2b795-8567-48fa-81d6-985a8f168f87", "tag": "0467bd1c-73a7-463d-8aa3-9018ce655dae"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:34:22.940138 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:34:22.940138 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:34:22.949814 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-c20ff16d-5c6d-46c3-bfbb-ca36261b7a7f req-89bfb79e-8395-4458-a71e-222d436a576b service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:22.950511 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-c20ff16d-5c6d-46c3-bfbb-ca36261b7a7f req-89bfb79e-8395-4458-a71e-222d436a576b service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:22.952115 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-a3c783c4-f183-4867-921c-12dbc16f83e7 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87" status: 200 len: 1362 microversion: 2.1 time: 0.818637 May 03 21:34:22.960793 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 348/757] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:22 2022] GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87 => generated 1362 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:22.976732 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-c20ff16d-5c6d-46c3-bfbb-ca36261b7a7f req-89bfb79e-8395-4458-a71e-222d436a576b service nova] Creating event network-changed:0467bd1c-73a7-463d-8aa3-9018ce655dae for instance aab2b795-8567-48fa-81d6-985a8f168f87 on hv-cinder-84037 May 03 21:34:22.981822 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-c20ff16d-5c6d-46c3-bfbb-ca36261b7a7f req-89bfb79e-8395-4458-a71e-222d436a576b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057552 May 03 21:34:22.982692 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 410/758] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:34:23.668166 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-f82ae16e-8923-49b0-bd53-53da830e1d55 req-38d47654-b211-4166-8d56-bc257468aa09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49b86a80-657d-4e94-bc71-bcfe8f276469", "tag": "4a088512-8058-4a9a-a45b-177671d97cfc"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:34:23.695754 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:34:23.695754 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:34:23.712470 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-f82ae16e-8923-49b0-bd53-53da830e1d55 req-38d47654-b211-4166-8d56-bc257468aa09 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:23.712802 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-f82ae16e-8923-49b0-bd53-53da830e1d55 req-38d47654-b211-4166-8d56-bc257468aa09 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:23.730313 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-f82ae16e-8923-49b0-bd53-53da830e1d55 req-38d47654-b211-4166-8d56-bc257468aa09 service nova] Creating event network-changed:4a088512-8058-4a9a-a45b-177671d97cfc for instance 49b86a80-657d-4e94-bc71-bcfe8f276469 on hv-cinder-84037 May 03 21:34:23.736149 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-f82ae16e-8923-49b0-bd53-53da830e1d55 req-38d47654-b211-4166-8d56-bc257468aa09 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.384965 May 03 21:34:23.736785 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 349/759] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:34:23.764211 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-1b8f4a6d-f166-464d-b097-8ea0419457c0 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:23.765027 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-1b8f4a6d-f166-464d-b097-8ea0419457c0 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:23.773459 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-1b8f4a6d-f166-464d-b097-8ea0419457c0 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:23.774011 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-1b8f4a6d-f166-464d-b097-8ea0419457c0 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:23.774913 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-1b8f4a6d-f166-464d-b097-8ea0419457c0 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:23.782104 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-1b8f4a6d-f166-464d-b097-8ea0419457c0 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:23.945069 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-9f1d2630-2db1-4a18-afb2-0a221626f43d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:23.950279 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-9f1d2630-2db1-4a18-afb2-0a221626f43d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:23.970921 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9f1d2630-2db1-4a18-afb2-0a221626f43d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:23.971589 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9f1d2630-2db1-4a18-afb2-0a221626f43d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:23.977512 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9f1d2630-2db1-4a18-afb2-0a221626f43d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:23.978324 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9f1d2630-2db1-4a18-afb2-0a221626f43d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:24.145493 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-1b8f4a6d-f166-464d-b097-8ea0419457c0 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:24.169745 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-9f1d2630-2db1-4a18-afb2-0a221626f43d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.238635 May 03 21:34:24.169985 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-1b8f4a6d-f166-464d-b097-8ea0419457c0 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1751 microversion: 2.1 time: 0.416110 May 03 21:34:24.171030 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 350/760] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 3 21:34:23 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52/os-volume_attachments => generated 197 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:34:24.178500 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 411/761] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:23 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1751 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:24.183405 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-8343c4a1-8399-4833-825a-0f65df8e04c1 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:24.184330 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-8343c4a1-8399-4833-825a-0f65df8e04c1 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:24.193629 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8343c4a1-8399-4833-825a-0f65df8e04c1 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:24.194351 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8343c4a1-8399-4833-825a-0f65df8e04c1 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:24.195309 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8343c4a1-8399-4833-825a-0f65df8e04c1 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:24.196260 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8343c4a1-8399-4833-825a-0f65df8e04c1 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:25.196887 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-a0b9a93d-8a6a-417e-83c3-cde9c27ccc66 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:25.205570 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-a0b9a93d-8a6a-417e-83c3-cde9c27ccc66 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:25.215254 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a0b9a93d-8a6a-417e-83c3-cde9c27ccc66 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:25.216027 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a0b9a93d-8a6a-417e-83c3-cde9c27ccc66 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:25.217125 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a0b9a93d-8a6a-417e-83c3-cde9c27ccc66 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:25.217803 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a0b9a93d-8a6a-417e-83c3-cde9c27ccc66 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:25.298568 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-a0b9a93d-8a6a-417e-83c3-cde9c27ccc66 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117165 May 03 21:34:25.303468 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 412/762] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 3 21:34:25 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:34:25.317669 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-18e2b045-7b5c-4657-b0dc-16eb4564efe9 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:25.318583 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-18e2b045-7b5c-4657-b0dc-16eb4564efe9 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:25.328102 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-18e2b045-7b5c-4657-b0dc-16eb4564efe9 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:25.328913 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-18e2b045-7b5c-4657-b0dc-16eb4564efe9 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:25.329885 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-18e2b045-7b5c-4657-b0dc-16eb4564efe9 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:25.330480 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-18e2b045-7b5c-4657-b0dc-16eb4564efe9 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:25.389536 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-8343c4a1-8399-4833-825a-0f65df8e04c1 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:25.418642 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-8343c4a1-8399-4833-825a-0f65df8e04c1 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87" status: 200 len: 1362 microversion: 2.1 time: 1.245494 May 03 21:34:25.419850 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 351/763] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:24 2022] GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87 => generated 1362 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:25.662250 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-18e2b045-7b5c-4657-b0dc-16eb4564efe9 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:25.678758 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-18e2b045-7b5c-4657-b0dc-16eb4564efe9 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1751 microversion: 2.1 time: 0.373880 May 03 21:34:25.681568 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 413/764] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:25 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1751 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:26.317018 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-dfd4d89a-bb3b-4d7d-8095-99b733db7793 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:26.332488 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-dfd4d89a-bb3b-4d7d-8095-99b733db7793 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:26.342369 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-dfd4d89a-bb3b-4d7d-8095-99b733db7793 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:26.343053 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-dfd4d89a-bb3b-4d7d-8095-99b733db7793 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:26.344629 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-dfd4d89a-bb3b-4d7d-8095-99b733db7793 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:26.345230 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-dfd4d89a-bb3b-4d7d-8095-99b733db7793 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:26.442326 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-dfd4d89a-bb3b-4d7d-8095-99b733db7793 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.135512 May 03 21:34:26.443236 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 352/765] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 3 21:34:26 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52/os-volume_attachments => generated 25 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 03 21:34:26.463996 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-70199243-55ea-4377-a023-0f66d60b22af tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:26.465070 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-70199243-55ea-4377-a023-0f66d60b22af tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:26.502873 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-70199243-55ea-4377-a023-0f66d60b22af tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:26.503731 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-70199243-55ea-4377-a023-0f66d60b22af tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:26.504776 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-70199243-55ea-4377-a023-0f66d60b22af tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:26.505421 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-70199243-55ea-4377-a023-0f66d60b22af tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:26.719346 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-f5991d5c-b275-4e47-b187-19357edee5c4 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:26.720647 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-f5991d5c-b275-4e47-b187-19357edee5c4 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:26.752101 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f5991d5c-b275-4e47-b187-19357edee5c4 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:26.752590 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f5991d5c-b275-4e47-b187-19357edee5c4 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:26.753444 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f5991d5c-b275-4e47-b187-19357edee5c4 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:26.753930 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f5991d5c-b275-4e47-b187-19357edee5c4 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:26.990646 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-70199243-55ea-4377-a023-0f66d60b22af tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:27.001306 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-70199243-55ea-4377-a023-0f66d60b22af tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87" status: 200 len: 1362 microversion: 2.1 time: 0.569268 May 03 21:34:27.011349 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 414/766] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:26 2022] GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87 => generated 1362 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:34:27.019268 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-582bc2ab-2848-48d7-93ea-8d2bb6d4e2d1 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:27.030739 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-582bc2ab-2848-48d7-93ea-8d2bb6d4e2d1 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:27.032029 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-582bc2ab-2848-48d7-93ea-8d2bb6d4e2d1 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:27.032236 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-582bc2ab-2848-48d7-93ea-8d2bb6d4e2d1 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:27.033033 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-582bc2ab-2848-48d7-93ea-8d2bb6d4e2d1 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:27.033462 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-582bc2ab-2848-48d7-93ea-8d2bb6d4e2d1 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:27.110954 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-582bc2ab-2848-48d7-93ea-8d2bb6d4e2d1 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Going to try to terminate instance {{(pid=97832) delete /opt/stack/nova/nova/compute/api.py:2559}} May 03 21:34:27.549595 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-582bc2ab-2848-48d7-93ea-8d2bb6d4e2d1 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 204 len: 0 microversion: 2.1 time: 0.540461 May 03 21:34:27.550263 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 415/767] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 3 21:34:27 2022] DELETE /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 03 21:34:27.565834 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-b2eb94ed-6844-49c8-88c0-9742533fdfaa tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:27.566607 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-b2eb94ed-6844-49c8-88c0-9742533fdfaa tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:27.574764 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b2eb94ed-6844-49c8-88c0-9742533fdfaa tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:27.575295 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b2eb94ed-6844-49c8-88c0-9742533fdfaa tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:27.576085 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b2eb94ed-6844-49c8-88c0-9742533fdfaa tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:27.576734 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b2eb94ed-6844-49c8-88c0-9742533fdfaa tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:27.765065 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-f5991d5c-b275-4e47-b187-19357edee5c4 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:27.783294 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-f5991d5c-b275-4e47-b187-19357edee5c4 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1756 microversion: 2.1 time: 1.087907 May 03 21:34:27.788492 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 353/768] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:26 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1756 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:27.913401 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-b2eb94ed-6844-49c8-88c0-9742533fdfaa tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:27.927358 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-b2eb94ed-6844-49c8-88c0-9742533fdfaa tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1690 microversion: 2.1 time: 0.372739 May 03 21:34:27.928514 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 416/769] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:27 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1690 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:34:28.025592 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-5e8b12f2-007c-4de4-b4ed-d8c52b3a779a tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:28.026392 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-5e8b12f2-007c-4de4-b4ed-d8c52b3a779a tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:28.036264 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5e8b12f2-007c-4de4-b4ed-d8c52b3a779a tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:28.036664 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5e8b12f2-007c-4de4-b4ed-d8c52b3a779a tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:28.037492 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5e8b12f2-007c-4de4-b4ed-d8c52b3a779a tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:28.037928 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5e8b12f2-007c-4de4-b4ed-d8c52b3a779a tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:28.608320 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-5e8b12f2-007c-4de4-b4ed-d8c52b3a779a tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:28.620712 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-5e8b12f2-007c-4de4-b4ed-d8c52b3a779a tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87" status: 200 len: 1362 microversion: 2.1 time: 0.604432 May 03 21:34:28.654631 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 354/770] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:28 2022] GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87 => generated 1362 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:28.812317 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-d91c68fa-5f38-4cb8-bf90-52a5b763102a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:28.812893 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-d91c68fa-5f38-4cb8-bf90-52a5b763102a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:28.829796 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d91c68fa-5f38-4cb8-bf90-52a5b763102a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:28.832720 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d91c68fa-5f38-4cb8-bf90-52a5b763102a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:28.833924 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d91c68fa-5f38-4cb8-bf90-52a5b763102a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:28.837161 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d91c68fa-5f38-4cb8-bf90-52a5b763102a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:28.959923 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-4efe5b89-30fe-4822-be04-1e783d6daa72 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:28.961978 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-4efe5b89-30fe-4822-be04-1e783d6daa72 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:28.979130 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4efe5b89-30fe-4822-be04-1e783d6daa72 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:28.981127 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4efe5b89-30fe-4822-be04-1e783d6daa72 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:28.983032 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4efe5b89-30fe-4822-be04-1e783d6daa72 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:28.984869 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4efe5b89-30fe-4822-be04-1e783d6daa72 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:29.144032 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-d91c68fa-5f38-4cb8-bf90-52a5b763102a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:29.164181 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-d91c68fa-5f38-4cb8-bf90-52a5b763102a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1756 microversion: 2.1 time: 0.365765 May 03 21:34:29.165114 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 417/771] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:28 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1756 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:29.424134 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-4efe5b89-30fe-4822-be04-1e783d6daa72 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:29.432499 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-4efe5b89-30fe-4822-be04-1e783d6daa72 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1690 microversion: 2.1 time: 0.490817 May 03 21:34:29.433976 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 355/772] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:28 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1690 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:29.646008 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-b6a9d846-bb82-4fa4-b09d-6781dc2c07db tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:29.646636 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-b6a9d846-bb82-4fa4-b09d-6781dc2c07db tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:29.654875 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b6a9d846-bb82-4fa4-b09d-6781dc2c07db tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:29.655319 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b6a9d846-bb82-4fa4-b09d-6781dc2c07db tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:29.657409 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b6a9d846-bb82-4fa4-b09d-6781dc2c07db tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:29.657847 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b6a9d846-bb82-4fa4-b09d-6781dc2c07db tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:29.925734 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-b6a9d846-bb82-4fa4-b09d-6781dc2c07db tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:29.934903 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-b6a9d846-bb82-4fa4-b09d-6781dc2c07db tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87" status: 200 len: 1362 microversion: 2.1 time: 0.299504 May 03 21:34:29.937062 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 418/773] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:29 2022] GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87 => generated 1362 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:30.204962 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-7b5253dc-3e8e-40d1-b0ac-bd6a2e11f0f8 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:30.210495 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-7b5253dc-3e8e-40d1-b0ac-bd6a2e11f0f8 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:30.214258 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7b5253dc-3e8e-40d1-b0ac-bd6a2e11f0f8 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:30.214715 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7b5253dc-3e8e-40d1-b0ac-bd6a2e11f0f8 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:30.215495 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7b5253dc-3e8e-40d1-b0ac-bd6a2e11f0f8 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:30.216255 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7b5253dc-3e8e-40d1-b0ac-bd6a2e11f0f8 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:30.467876 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-0b2fec9e-6613-46f9-b062-8c7846f9c9ae tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:30.470295 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-0b2fec9e-6613-46f9-b062-8c7846f9c9ae tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:30.483736 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0b2fec9e-6613-46f9-b062-8c7846f9c9ae tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:30.485301 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0b2fec9e-6613-46f9-b062-8c7846f9c9ae tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:30.486985 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0b2fec9e-6613-46f9-b062-8c7846f9c9ae tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:30.487675 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0b2fec9e-6613-46f9-b062-8c7846f9c9ae tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:30.592053 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-7b5253dc-3e8e-40d1-b0ac-bd6a2e11f0f8 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:30.602885 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-7b5253dc-3e8e-40d1-b0ac-bd6a2e11f0f8 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1756 microversion: 2.1 time: 0.408139 May 03 21:34:30.614051 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 356/774] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:30 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1756 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:30.863335 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-0b2fec9e-6613-46f9-b062-8c7846f9c9ae tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:30.873486 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-0b2fec9e-6613-46f9-b062-8c7846f9c9ae tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1690 microversion: 2.1 time: 0.426399 May 03 21:34:30.884762 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 419/775] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:30 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1690 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:34:30.958389 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-80812910-df19-4894-9530-aa92a9b37544 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:30.959015 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-80812910-df19-4894-9530-aa92a9b37544 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:30.973227 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-80812910-df19-4894-9530-aa92a9b37544 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:30.973683 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-80812910-df19-4894-9530-aa92a9b37544 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:30.974819 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-80812910-df19-4894-9530-aa92a9b37544 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:30.975269 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-80812910-df19-4894-9530-aa92a9b37544 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:31.371886 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-80812910-df19-4894-9530-aa92a9b37544 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:31.382842 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-80812910-df19-4894-9530-aa92a9b37544 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87" status: 200 len: 1362 microversion: 2.1 time: 0.435315 May 03 21:34:31.383850 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 357/776] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:30 2022] GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87 => generated 1362 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:31.627886 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-b01bb5ff-f80f-4007-9b69-5fca19b7b69d tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:31.629328 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-b01bb5ff-f80f-4007-9b69-5fca19b7b69d tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:31.638104 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b01bb5ff-f80f-4007-9b69-5fca19b7b69d tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:31.638898 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b01bb5ff-f80f-4007-9b69-5fca19b7b69d tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:31.640328 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b01bb5ff-f80f-4007-9b69-5fca19b7b69d tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:31.641118 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b01bb5ff-f80f-4007-9b69-5fca19b7b69d tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:31.873720 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-b01bb5ff-f80f-4007-9b69-5fca19b7b69d tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:31.886902 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-b01bb5ff-f80f-4007-9b69-5fca19b7b69d tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1756 microversion: 2.1 time: 0.267293 May 03 21:34:31.886902 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 420/777] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:31 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1756 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:31.896960 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-56b86d34-cfe1-4492-8e8d-9ac2881d5ce9 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:31.897834 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-56b86d34-cfe1-4492-8e8d-9ac2881d5ce9 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:31.905459 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-56b86d34-cfe1-4492-8e8d-9ac2881d5ce9 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:31.906842 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-56b86d34-cfe1-4492-8e8d-9ac2881d5ce9 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:31.907791 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-56b86d34-cfe1-4492-8e8d-9ac2881d5ce9 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:31.908244 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-56b86d34-cfe1-4492-8e8d-9ac2881d5ce9 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:32.410919 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-d48ce3f3-5c94-4ba7-8aa8-66a04de7fbc9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:32.412163 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-d48ce3f3-5c94-4ba7-8aa8-66a04de7fbc9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:32.432211 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d48ce3f3-5c94-4ba7-8aa8-66a04de7fbc9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:32.433105 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d48ce3f3-5c94-4ba7-8aa8-66a04de7fbc9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:32.434079 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d48ce3f3-5c94-4ba7-8aa8-66a04de7fbc9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:32.435045 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d48ce3f3-5c94-4ba7-8aa8-66a04de7fbc9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:32.576709 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-56b86d34-cfe1-4492-8e8d-9ac2881d5ce9 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:32.586638 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-56b86d34-cfe1-4492-8e8d-9ac2881d5ce9 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1690 microversion: 2.1 time: 0.699353 May 03 21:34:32.587270 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 358/778] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:31 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1690 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:34:32.754733 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-d48ce3f3-5c94-4ba7-8aa8-66a04de7fbc9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:32.763082 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-d48ce3f3-5c94-4ba7-8aa8-66a04de7fbc9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87" status: 200 len: 1362 microversion: 2.1 time: 0.365094 May 03 21:34:32.764107 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 421/779] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:32 2022] GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87 => generated 1362 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:32.909137 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-6c9898ee-89bb-46ae-8d2e-34d8aa8b186a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:32.909872 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-6c9898ee-89bb-46ae-8d2e-34d8aa8b186a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:32.918754 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6c9898ee-89bb-46ae-8d2e-34d8aa8b186a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:32.919338 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6c9898ee-89bb-46ae-8d2e-34d8aa8b186a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:32.920199 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6c9898ee-89bb-46ae-8d2e-34d8aa8b186a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:32.922237 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6c9898ee-89bb-46ae-8d2e-34d8aa8b186a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:33.308156 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-6c9898ee-89bb-46ae-8d2e-34d8aa8b186a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:33.320557 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-6c9898ee-89bb-46ae-8d2e-34d8aa8b186a tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1756 microversion: 2.1 time: 0.421946 May 03 21:34:33.331415 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 359/780] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:32 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1756 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:34:33.368152 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-498c987a-37d1-4db2-b536-2ded3666ba89 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:33.368699 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-498c987a-37d1-4db2-b536-2ded3666ba89 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 1233302d-c8af-43d2-9b77-4394d2674961] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:33.380190 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-498c987a-37d1-4db2-b536-2ded3666ba89 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:33.380190 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-498c987a-37d1-4db2-b536-2ded3666ba89 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:33.380190 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-498c987a-37d1-4db2-b536-2ded3666ba89 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:33.380190 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-498c987a-37d1-4db2-b536-2ded3666ba89 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:33.448289 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-498c987a-37d1-4db2-b536-2ded3666ba89 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961/ips" status: 200 len: 147 microversion: 2.1 time: 0.324709 May 03 21:34:33.449117 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 422/781] 10.222.0.48 () {58 vars in 1247 bytes} [Tue May 3 21:34:33 2022] GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961/ips => generated 147 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:34:33.617727 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-f011b991-9b74-42b2-8d60-0b31a1530d33 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:33.619226 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-f011b991-9b74-42b2-8d60-0b31a1530d33 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:33.649431 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f011b991-9b74-42b2-8d60-0b31a1530d33 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:33.650401 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f011b991-9b74-42b2-8d60-0b31a1530d33 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:33.652103 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f011b991-9b74-42b2-8d60-0b31a1530d33 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:33.653002 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f011b991-9b74-42b2-8d60-0b31a1530d33 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:33.786906 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-54b8b9f6-23a4-4e61-ba03-57cc724a7a65 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:33.787631 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-54b8b9f6-23a4-4e61-ba03-57cc724a7a65 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:33.795041 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-54b8b9f6-23a4-4e61-ba03-57cc724a7a65 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:33.795494 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-54b8b9f6-23a4-4e61-ba03-57cc724a7a65 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:33.796898 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-54b8b9f6-23a4-4e61-ba03-57cc724a7a65 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:33.797409 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-54b8b9f6-23a4-4e61-ba03-57cc724a7a65 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:33.880959 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-f011b991-9b74-42b2-8d60-0b31a1530d33 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:33.889668 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-f011b991-9b74-42b2-8d60-0b31a1530d33 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1622 microversion: 2.1 time: 0.288805 May 03 21:34:33.891158 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 360/782] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:33 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1622 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:34.033286 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-54b8b9f6-23a4-4e61-ba03-57cc724a7a65 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:34.048525 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-54b8b9f6-23a4-4e61-ba03-57cc724a7a65 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87" status: 200 len: 1362 microversion: 2.1 time: 0.270961 May 03 21:34:34.049368 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 423/783] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:33 2022] GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87 => generated 1362 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:34:34.347556 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-849367c7-1784-4255-971b-966db984703e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:34.348179 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-849367c7-1784-4255-971b-966db984703e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:34.356053 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-849367c7-1784-4255-971b-966db984703e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:34.356536 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-849367c7-1784-4255-971b-966db984703e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:34.357654 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-849367c7-1784-4255-971b-966db984703e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:34.358117 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-849367c7-1784-4255-971b-966db984703e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:34.824957 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-849367c7-1784-4255-971b-966db984703e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:34.836053 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-849367c7-1784-4255-971b-966db984703e tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1756 microversion: 2.1 time: 0.500846 May 03 21:34:34.837068 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 361/784] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:34 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1756 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:34.851615 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-806b2d0c-e029-4e05-a09f-50b5ced1dc5a req-408a894c-8492-4d11-8dea-9789d28de8ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab2b795-8567-48fa-81d6-985a8f168f87", "name": "network-vif-plugged", "status": "completed", "tag": "0467bd1c-73a7-463d-8aa3-9018ce655dae"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:34:34.860744 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:34:34.860744 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:34:34.869378 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-806b2d0c-e029-4e05-a09f-50b5ced1dc5a req-408a894c-8492-4d11-8dea-9789d28de8ae service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:34.870097 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-806b2d0c-e029-4e05-a09f-50b5ced1dc5a req-408a894c-8492-4d11-8dea-9789d28de8ae service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:34.888463 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-806b2d0c-e029-4e05-a09f-50b5ced1dc5a req-408a894c-8492-4d11-8dea-9789d28de8ae service nova] Creating event network-vif-plugged:0467bd1c-73a7-463d-8aa3-9018ce655dae for instance aab2b795-8567-48fa-81d6-985a8f168f87 on hv-cinder-84037 May 03 21:34:34.893688 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-806b2d0c-e029-4e05-a09f-50b5ced1dc5a req-408a894c-8492-4d11-8dea-9789d28de8ae service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051074 May 03 21:34:34.894305 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 424/785] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:34:34.915698 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-d27fd53c-35a8-499f-8b40-37ac734be94e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:34.916659 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-d27fd53c-35a8-499f-8b40-37ac734be94e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:34.929805 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d27fd53c-35a8-499f-8b40-37ac734be94e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:34.930740 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d27fd53c-35a8-499f-8b40-37ac734be94e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:34.932151 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d27fd53c-35a8-499f-8b40-37ac734be94e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:34.932840 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d27fd53c-35a8-499f-8b40-37ac734be94e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:34.978863 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-06505a3c-06eb-4419-b2b8-85ba14e5552b req-3c7ed4a0-cdbf-42d5-80e0-fc1d5a7bdfe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb2b9b5d-640a-401a-ac60-566b6d8dbc52", "name": "network-vif-deleted", "tag": "a2903b13-fffc-4e5f-9a12-4bcb585327dd"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:34:35.011213 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:34:35.011213 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:34:35.028758 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-06505a3c-06eb-4419-b2b8-85ba14e5552b req-3c7ed4a0-cdbf-42d5-80e0-fc1d5a7bdfe5 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:35.029564 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-06505a3c-06eb-4419-b2b8-85ba14e5552b req-3c7ed4a0-cdbf-42d5-80e0-fc1d5a7bdfe5 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:35.049104 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-06505a3c-06eb-4419-b2b8-85ba14e5552b req-3c7ed4a0-cdbf-42d5-80e0-fc1d5a7bdfe5 service nova] Creating event network-vif-deleted:a2903b13-fffc-4e5f-9a12-4bcb585327dd for instance cb2b9b5d-640a-401a-ac60-566b6d8dbc52 on hv-cinder-84037 May 03 21:34:35.055291 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-06505a3c-06eb-4419-b2b8-85ba14e5552b req-3c7ed4a0-cdbf-42d5-80e0-fc1d5a7bdfe5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108887 May 03 21:34:35.056701 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 425/786] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:34:35.077177 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-b9037728-187d-4c54-a532-4cca22d7c835 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:35.079474 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-b9037728-187d-4c54-a532-4cca22d7c835 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:35.092286 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b9037728-187d-4c54-a532-4cca22d7c835 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:35.094620 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b9037728-187d-4c54-a532-4cca22d7c835 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:35.095702 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b9037728-187d-4c54-a532-4cca22d7c835 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:35.096597 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b9037728-187d-4c54-a532-4cca22d7c835 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:35.397683 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-b9037728-187d-4c54-a532-4cca22d7c835 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:35.409159 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-b9037728-187d-4c54-a532-4cca22d7c835 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87" status: 200 len: 1362 microversion: 2.1 time: 0.344362 May 03 21:34:35.411385 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 426/787] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:35 2022] GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87 => generated 1362 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:35.658410 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-b69fc4e6-0aac-4461-a90e-caab2f269371 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1fc40344-9bf5-4cab-9858-6f50517b586a"}} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:34:35.663104 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-b69fc4e6-0aac-4461-a90e-caab2f269371 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 1233302d-c8af-43d2-9b77-4394d2674961] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:35.663530 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-d27fd53c-35a8-499f-8b40-37ac734be94e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:35.678074 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b69fc4e6-0aac-4461-a90e-caab2f269371 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:35.678343 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b69fc4e6-0aac-4461-a90e-caab2f269371 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:35.679130 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b69fc4e6-0aac-4461-a90e-caab2f269371 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:35.679560 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b69fc4e6-0aac-4461-a90e-caab2f269371 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:35.681190 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-d27fd53c-35a8-499f-8b40-37ac734be94e tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1622 microversion: 2.1 time: 0.776041 May 03 21:34:35.682761 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 362/788] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:34 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1622 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:35.860569 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-1fd0aa63-8d10-4ab1-82bf-eac6043a0eef tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:35.862986 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-1fd0aa63-8d10-4ab1-82bf-eac6043a0eef tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:35.878857 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1fd0aa63-8d10-4ab1-82bf-eac6043a0eef tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:35.879300 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1fd0aa63-8d10-4ab1-82bf-eac6043a0eef tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:35.880064 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1fd0aa63-8d10-4ab1-82bf-eac6043a0eef tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:35.880517 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1fd0aa63-8d10-4ab1-82bf-eac6043a0eef tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:36.152828 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-1fd0aa63-8d10-4ab1-82bf-eac6043a0eef tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:36.162584 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-1fd0aa63-8d10-4ab1-82bf-eac6043a0eef tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1756 microversion: 2.1 time: 0.312679 May 03 21:34:36.163135 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 363/789] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:35 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1756 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:34:36.411379 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-3423dd3c-9eda-411f-8a0c-ec7bcf394b0f tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Action: 'create', calling method: .version_select at 0x7fc84ce5ec10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-103237313"}} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:34:36.439148 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-3423dd3c-9eda-411f-8a0c-ec7bcf394b0f tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Getting quotas for project e665d5aad2c24ad7843ca060d41792d3. Resources: {'key_pairs'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:34:36.443134 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-3423dd3c-9eda-411f-8a0c-ec7bcf394b0f tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Getting quotas for user 2873b6c651a94d4992d0debcab8aeafd and project e665d5aad2c24ad7843ca060d41792d3. Resources: {'key_pairs'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:34:36.779533 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-3423dd3c-9eda-411f-8a0c-ec7bcf394b0f tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Getting quotas for project e665d5aad2c24ad7843ca060d41792d3. Resources: {'key_pairs'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:34:36.786961 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-3423dd3c-9eda-411f-8a0c-ec7bcf394b0f tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Getting quotas for user 2873b6c651a94d4992d0debcab8aeafd and project e665d5aad2c24ad7843ca060d41792d3. Resources: {'key_pairs'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:34:36.807881 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-3423dd3c-9eda-411f-8a0c-ec7bcf394b0f tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.643246 May 03 21:34:36.808809 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 364/790] 10.222.0.48 () {60 vars in 1157 bytes} [Tue May 3 21:34:36 2022] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:36.824227 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-81c09473-f8d4-48fd-b99e-213d84844e47 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:36.838284 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-81c09473-f8d4-48fd-b99e-213d84844e47 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:36.842765 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-81c09473-f8d4-48fd-b99e-213d84844e47 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:36.844401 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-81c09473-f8d4-48fd-b99e-213d84844e47 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:36.845786 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-81c09473-f8d4-48fd-b99e-213d84844e47 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:36.846381 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-81c09473-f8d4-48fd-b99e-213d84844e47 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:36.961936 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-b69fc4e6-0aac-4461-a90e-caab2f269371 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "POST /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.318173 May 03 21:34:36.966142 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 427/791] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 3 21:34:35 2022] POST /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961/os-volume_attachments => generated 194 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:34:36.991752 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-712a16c0-6c13-41e5-88af-77e6f3663e6d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:36.992867 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-712a16c0-6c13-41e5-88af-77e6f3663e6d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:37.003941 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-712a16c0-6c13-41e5-88af-77e6f3663e6d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:37.008383 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-712a16c0-6c13-41e5-88af-77e6f3663e6d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:37.008383 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-712a16c0-6c13-41e5-88af-77e6f3663e6d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:37.008383 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-712a16c0-6c13-41e5-88af-77e6f3663e6d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:37.102565 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-712a16c0-6c13-41e5-88af-77e6f3663e6d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:37.103311 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-712a16c0-6c13-41e5-88af-77e6f3663e6d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:37.103924 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.objects.instance [None req-712a16c0-6c13-41e5-88af-77e6f3663e6d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lazy-loading 'fault' on Instance uuid cb2b9b5d-640a-401a-ac60-566b6d8dbc52 {{(pid=97832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 03 21:34:37.182309 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-81c09473-f8d4-48fd-b99e-213d84844e47 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:37.193227 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-81c09473-f8d4-48fd-b99e-213d84844e47 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87" status: 200 len: 1362 microversion: 2.1 time: 0.383097 May 03 21:34:37.193764 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 365/792] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:36 2022] GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87 => generated 1362 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:37.214622 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-0dac74de-7c3a-4f37-8358-086c83dcb9e2 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:37.215228 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-0dac74de-7c3a-4f37-8358-086c83dcb9e2 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:37.231190 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0dac74de-7c3a-4f37-8358-086c83dcb9e2 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:37.231651 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0dac74de-7c3a-4f37-8358-086c83dcb9e2 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:37.232498 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0dac74de-7c3a-4f37-8358-086c83dcb9e2 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:37.236309 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0dac74de-7c3a-4f37-8358-086c83dcb9e2 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:37.256822 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-712a16c0-6c13-41e5-88af-77e6f3663e6d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:37.273368 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-712a16c0-6c13-41e5-88af-77e6f3663e6d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 200 len: 1334 microversion: 2.1 time: 0.305633 May 03 21:34:37.274532 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 428/793] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:36 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 1334 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:37.488704 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-0dac74de-7c3a-4f37-8358-086c83dcb9e2 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:37.499988 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-0dac74de-7c3a-4f37-8358-086c83dcb9e2 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1756 microversion: 2.1 time: 0.296081 May 03 21:34:37.504174 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 366/794] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:37 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1756 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:38.217053 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-d86cdae6-820b-45e3-8f63-2a7bb090bc54 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:38.217680 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-d86cdae6-820b-45e3-8f63-2a7bb090bc54 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:38.226973 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d86cdae6-820b-45e3-8f63-2a7bb090bc54 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:38.227441 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d86cdae6-820b-45e3-8f63-2a7bb090bc54 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:38.228227 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d86cdae6-820b-45e3-8f63-2a7bb090bc54 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:38.228698 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d86cdae6-820b-45e3-8f63-2a7bb090bc54 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:38.299189 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-2c8691ce-245f-4479-a19b-14c780654963 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:38.299812 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-2c8691ce-245f-4479-a19b-14c780654963 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: cb2b9b5d-640a-401a-ac60-566b6d8dbc52] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:38.307320 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2c8691ce-245f-4479-a19b-14c780654963 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:38.307886 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2c8691ce-245f-4479-a19b-14c780654963 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:38.308720 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2c8691ce-245f-4479-a19b-14c780654963 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:38.309158 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2c8691ce-245f-4479-a19b-14c780654963 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:38.365640 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.wsgi [None req-2c8691ce-245f-4479-a19b-14c780654963 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] HTTP exception thrown: Instance cb2b9b5d-640a-401a-ac60-566b6d8dbc52 could not be found. May 03 21:34:38.366463 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-2c8691ce-245f-4479-a19b-14c780654963 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Returning 404 to user: Instance cb2b9b5d-640a-401a-ac60-566b6d8dbc52 could not be found. {{(pid=97831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:34:38.367397 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-2c8691ce-245f-4479-a19b-14c780654963 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52" status: 404 len: 111 microversion: 2.1 time: 0.077914 May 03 21:34:38.367957 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 367/795] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:38 2022] GET /compute/v2.1/servers/cb2b9b5d-640a-401a-ac60-566b6d8dbc52 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 03 21:34:38.382885 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-01dd19f9-8820-43a4-a44e-c2404f895ff1 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '.version_select at 0x7fc84cd673a0>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:38.486080 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-d86cdae6-820b-45e3-8f63-2a7bb090bc54 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:38.496359 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-d86cdae6-820b-45e3-8f63-2a7bb090bc54 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87" status: 200 len: 1548 microversion: 2.1 time: 0.288899 May 03 21:34:38.497435 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 429/796] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:38 2022] GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87 => generated 1548 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:38.519293 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-5018b65b-e0bb-4271-95d3-7f7d85a1294b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:38.519293 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-5018b65b-e0bb-4271-95d3-7f7d85a1294b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:38.526864 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5018b65b-e0bb-4271-95d3-7f7d85a1294b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:38.527311 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5018b65b-e0bb-4271-95d3-7f7d85a1294b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:38.528089 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5018b65b-e0bb-4271-95d3-7f7d85a1294b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:38.528549 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5018b65b-e0bb-4271-95d3-7f7d85a1294b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:38.575787 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-01dd19f9-8820-43a4-a44e-c2404f895ff1 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-494500117" status: 202 len: 0 microversion: 2.1 time: 0.202904 May 03 21:34:38.584997 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 368/797] 10.222.0.48 () {58 vars in 1217 bytes} [Tue May 3 21:34:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-494500117 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 03 21:34:38.589119 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-5c7eb32d-812e-4672-a1f7-3543d3b01aa0 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:38.590065 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-5c7eb32d-812e-4672-a1f7-3543d3b01aa0 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:38.608225 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5c7eb32d-812e-4672-a1f7-3543d3b01aa0 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:38.612629 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5c7eb32d-812e-4672-a1f7-3543d3b01aa0 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:38.628047 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5c7eb32d-812e-4672-a1f7-3543d3b01aa0 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:38.629263 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5c7eb32d-812e-4672-a1f7-3543d3b01aa0 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:38.722957 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-5018b65b-e0bb-4271-95d3-7f7d85a1294b tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.213563 May 03 21:34:38.723609 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 430/798] 10.222.0.48 () {58 vars in 1274 bytes} [Tue May 3 21:34:38 2022] GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87/os-interface => generated 285 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:34:38.994543 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-5c7eb32d-812e-4672-a1f7-3543d3b01aa0 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:39.004928 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-5c7eb32d-812e-4672-a1f7-3543d3b01aa0 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1756 microversion: 2.1 time: 0.427224 May 03 21:34:39.005570 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 369/799] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:38 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1756 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:40.030873 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-8bae1380-efd4-40d8-a168-6f5fdbf59d64 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:40.032234 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-8bae1380-efd4-40d8-a168-6f5fdbf59d64 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:40.040044 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8bae1380-efd4-40d8-a168-6f5fdbf59d64 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:40.040610 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8bae1380-efd4-40d8-a168-6f5fdbf59d64 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:40.041455 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8bae1380-efd4-40d8-a168-6f5fdbf59d64 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:40.042068 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8bae1380-efd4-40d8-a168-6f5fdbf59d64 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:40.489874 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-8bae1380-efd4-40d8-a168-6f5fdbf59d64 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:40.501013 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-8bae1380-efd4-40d8-a168-6f5fdbf59d64 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1756 microversion: 2.1 time: 0.480011 May 03 21:34:40.501729 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 431/800] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:40 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1756 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:41.472075 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-00e0b033-b693-4bf5-9cc1-cd5ecf3ca2a3 req-aebe2178-0366-496b-b359-2f4cd3e2c675 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aab2b795-8567-48fa-81d6-985a8f168f87", "tag": "0467bd1c-73a7-463d-8aa3-9018ce655dae"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:34:41.478690 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:34:41.478690 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:34:41.488579 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-00e0b033-b693-4bf5-9cc1-cd5ecf3ca2a3 req-aebe2178-0366-496b-b359-2f4cd3e2c675 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:41.489163 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-00e0b033-b693-4bf5-9cc1-cd5ecf3ca2a3 req-aebe2178-0366-496b-b359-2f4cd3e2c675 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:41.507131 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-00e0b033-b693-4bf5-9cc1-cd5ecf3ca2a3 req-aebe2178-0366-496b-b359-2f4cd3e2c675 service nova] Creating event network-changed:0467bd1c-73a7-463d-8aa3-9018ce655dae for instance aab2b795-8567-48fa-81d6-985a8f168f87 on hv-cinder-84037 May 03 21:34:41.512497 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-00e0b033-b693-4bf5-9cc1-cd5ecf3ca2a3 req-aebe2178-0366-496b-b359-2f4cd3e2c675 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049981 May 03 21:34:41.513205 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 370/801] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:34:41.525462 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-cff43972-5569-490a-8730-2b14be90ad7b tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:41.526199 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-cff43972-5569-490a-8730-2b14be90ad7b tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:41.534037 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cff43972-5569-490a-8730-2b14be90ad7b tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:41.534559 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cff43972-5569-490a-8730-2b14be90ad7b tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:41.535383 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cff43972-5569-490a-8730-2b14be90ad7b tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:41.535867 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cff43972-5569-490a-8730-2b14be90ad7b tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:41.838166 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-cff43972-5569-490a-8730-2b14be90ad7b tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:41.864355 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-cff43972-5569-490a-8730-2b14be90ad7b tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1756 microversion: 2.1 time: 0.348912 May 03 21:34:41.865035 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 432/802] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:41 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1756 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:34:42.909569 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-5031deb8-a0ba-48de-91ee-4a7757d0a281 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:42.911747 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-5031deb8-a0ba-48de-91ee-4a7757d0a281 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:42.931821 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5031deb8-a0ba-48de-91ee-4a7757d0a281 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:42.932556 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5031deb8-a0ba-48de-91ee-4a7757d0a281 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:42.933424 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5031deb8-a0ba-48de-91ee-4a7757d0a281 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:42.933863 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5031deb8-a0ba-48de-91ee-4a7757d0a281 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:43.278916 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-5031deb8-a0ba-48de-91ee-4a7757d0a281 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:43.290589 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-5031deb8-a0ba-48de-91ee-4a7757d0a281 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1756 microversion: 2.1 time: 0.405297 May 03 21:34:43.293822 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 371/803] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:42 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1756 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:44.315605 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-56478a6c-e77d-404d-90c1-867c22840c4b tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:44.316110 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-56478a6c-e77d-404d-90c1-867c22840c4b tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:44.323640 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-56478a6c-e77d-404d-90c1-867c22840c4b tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:44.324223 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-56478a6c-e77d-404d-90c1-867c22840c4b tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:44.338038 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-56478a6c-e77d-404d-90c1-867c22840c4b tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:44.338038 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-56478a6c-e77d-404d-90c1-867c22840c4b tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:44.586621 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-56478a6c-e77d-404d-90c1-867c22840c4b tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:44.596180 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-56478a6c-e77d-404d-90c1-867c22840c4b tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1759 microversion: 2.1 time: 0.291883 May 03 21:34:44.596681 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 433/804] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:44 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1759 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:44.917053 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-6cca44b0-c671-478c-a4ec-786340f9fc8a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:44.918008 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-6cca44b0-c671-478c-a4ec-786340f9fc8a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:44.925855 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6cca44b0-c671-478c-a4ec-786340f9fc8a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:44.926299 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6cca44b0-c671-478c-a4ec-786340f9fc8a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:44.927077 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6cca44b0-c671-478c-a4ec-786340f9fc8a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:44.927509 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6cca44b0-c671-478c-a4ec-786340f9fc8a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:45.008840 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-6cca44b0-c671-478c-a4ec-786340f9fc8a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Going to try to terminate instance {{(pid=97831) delete /opt/stack/nova/nova/compute/api.py:2559}} May 03 21:34:45.202833 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7b33f1a3-64dc-4501-919f-e660fca3730c] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 03 21:34:45.407754 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-6cca44b0-c671-478c-a4ec-786340f9fc8a tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "DELETE /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 204 len: 0 microversion: 2.1 time: 0.499419 May 03 21:34:45.408257 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 372/805] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 3 21:34:44 2022] DELETE /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 03 21:34:45.423002 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-1c86604f-5ebb-411a-9302-c361e33cc4c5 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:45.423618 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-1c86604f-5ebb-411a-9302-c361e33cc4c5 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:45.431440 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-1c86604f-5ebb-411a-9302-c361e33cc4c5 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:45.431893 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-1c86604f-5ebb-411a-9302-c361e33cc4c5 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:45.436052 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-1c86604f-5ebb-411a-9302-c361e33cc4c5 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:45.436052 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-1c86604f-5ebb-411a-9302-c361e33cc4c5 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:45.549847 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-8cd15b70-ad78-4501-ab70-eb93961ae43c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1fc40344-9bf5-4cab-9858-6f50517b586a"}} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:34:45.551439 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-8cd15b70-ad78-4501-ab70-eb93961ae43c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 1233302d-c8af-43d2-9b77-4394d2674961] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:45.559051 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8cd15b70-ad78-4501-ab70-eb93961ae43c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:45.559504 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8cd15b70-ad78-4501-ab70-eb93961ae43c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:45.560284 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8cd15b70-ad78-4501-ab70-eb93961ae43c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:45.560756 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8cd15b70-ad78-4501-ab70-eb93961ae43c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:45.631126 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.wsgi [None req-8cd15b70-ad78-4501-ab70-eb93961ae43c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] HTTP exception thrown: Invalid volume: volume 1fc40344-9bf5-4cab-9858-6f50517b586a already attached May 03 21:34:45.631732 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-8cd15b70-ad78-4501-ab70-eb93961ae43c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Returning 400 to user: Invalid volume: volume 1fc40344-9bf5-4cab-9858-6f50517b586a already attached {{(pid=97831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:34:45.632586 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-8cd15b70-ad78-4501-ab70-eb93961ae43c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "POST /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961/os-volume_attachments" status: 400 len: 120 microversion: 2.1 time: 0.093371 May 03 21:34:45.633411 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 373/806] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 3 21:34:45 2022] POST /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961/os-volume_attachments => generated 120 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 03 21:34:45.751865 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-aecea8bb-1ed9-41a3-a4a9-3cf4d495f80a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:45.752843 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-aecea8bb-1ed9-41a3-a4a9-3cf4d495f80a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 1233302d-c8af-43d2-9b77-4394d2674961] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:45.760239 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-aecea8bb-1ed9-41a3-a4a9-3cf4d495f80a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:45.760719 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-aecea8bb-1ed9-41a3-a4a9-3cf4d495f80a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:45.761493 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-aecea8bb-1ed9-41a3-a4a9-3cf4d495f80a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:45.765743 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-aecea8bb-1ed9-41a3-a4a9-3cf4d495f80a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:45.792739 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-1c86604f-5ebb-411a-9302-c361e33cc4c5 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:45.802408 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-1c86604f-5ebb-411a-9302-c361e33cc4c5 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1508 microversion: 2.1 time: 0.389869 May 03 21:34:45.802966 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 434/807] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:45 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1508 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:34:46.222005 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO oslo.messaging._drivers.impl_rabbit [-] [7b33f1a3-64dc-4501-919f-e660fca3730c] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 33836. May 03 21:34:46.269279 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-aecea8bb-1ed9-41a3-a4a9-3cf4d495f80a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961/os-volume_attachments/1fc40344-9bf5-4cab-9858-6f50517b586a" status: 202 len: 0 microversion: 2.1 time: 0.528706 May 03 21:34:46.269882 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 374/808] 10.222.0.48 () {58 vars in 1415 bytes} [Tue May 3 21:34:45 2022] DELETE /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961/os-volume_attachments/1fc40344-9bf5-4cab-9858-6f50517b586a => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 03 21:34:46.294176 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-ee15decb-27d5-428f-a4b2-96e07f1fe7e1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:46.296943 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-ee15decb-27d5-428f-a4b2-96e07f1fe7e1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 1233302d-c8af-43d2-9b77-4394d2674961] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:46.304710 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ee15decb-27d5-428f-a4b2-96e07f1fe7e1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:46.305165 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ee15decb-27d5-428f-a4b2-96e07f1fe7e1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:46.306131 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ee15decb-27d5-428f-a4b2-96e07f1fe7e1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:46.306925 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ee15decb-27d5-428f-a4b2-96e07f1fe7e1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:46.384025 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-ee15decb-27d5-428f-a4b2-96e07f1fe7e1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109506 May 03 21:34:46.384611 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 435/809] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 3 21:34:46 2022] GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:34:46.827582 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-a20e32e9-9a91-4220-8b52-1bd8f192ed14 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:46.828346 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-a20e32e9-9a91-4220-8b52-1bd8f192ed14 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:46.835935 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a20e32e9-9a91-4220-8b52-1bd8f192ed14 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:46.836393 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a20e32e9-9a91-4220-8b52-1bd8f192ed14 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:46.837221 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a20e32e9-9a91-4220-8b52-1bd8f192ed14 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:46.837659 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a20e32e9-9a91-4220-8b52-1bd8f192ed14 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:47.274857 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-a20e32e9-9a91-4220-8b52-1bd8f192ed14 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:47.284780 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-a20e32e9-9a91-4220-8b52-1bd8f192ed14 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1508 microversion: 2.1 time: 0.467252 May 03 21:34:47.292479 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 375/810] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:46 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1508 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:47.418273 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-ba69a7bb-bd1c-497f-bd1c-2bc6ae97ec87 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:47.422393 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-ba69a7bb-bd1c-497f-bd1c-2bc6ae97ec87 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 1233302d-c8af-43d2-9b77-4394d2674961] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:47.434878 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ba69a7bb-bd1c-497f-bd1c-2bc6ae97ec87 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:47.435674 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ba69a7bb-bd1c-497f-bd1c-2bc6ae97ec87 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:47.436843 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ba69a7bb-bd1c-497f-bd1c-2bc6ae97ec87 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:47.437897 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ba69a7bb-bd1c-497f-bd1c-2bc6ae97ec87 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:47.526946 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-ba69a7bb-bd1c-497f-bd1c-2bc6ae97ec87 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134609 May 03 21:34:47.527653 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 436/811] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 3 21:34:47 2022] GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:34:48.311967 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-2de4ebef-ea8c-4471-b922-f79915cf4fcc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:48.314132 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-2de4ebef-ea8c-4471-b922-f79915cf4fcc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:48.322683 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2de4ebef-ea8c-4471-b922-f79915cf4fcc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:48.323153 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2de4ebef-ea8c-4471-b922-f79915cf4fcc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:48.324195 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2de4ebef-ea8c-4471-b922-f79915cf4fcc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:48.324624 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2de4ebef-ea8c-4471-b922-f79915cf4fcc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:48.516468 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-2de4ebef-ea8c-4471-b922-f79915cf4fcc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:48.526641 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-2de4ebef-ea8c-4471-b922-f79915cf4fcc tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1466 microversion: 2.1 time: 0.227741 May 03 21:34:48.527376 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 376/812] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:48 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1466 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:48.544066 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-2c55e8b0-f8df-4964-852c-2c5901b53b0d req-f3e3bfb2-6df5-4a70-af1d-50b91f289c80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11444b4c-e752-4766-9e89-f57974330390", "name": "network-vif-deleted", "tag": "85e667f2-845e-4e89-b387-1500b1f84677"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:34:48.544675 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-8163e6ed-8a10-4fec-81c7-45a794e3bb5c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:48.545690 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-8163e6ed-8a10-4fec-81c7-45a794e3bb5c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 1233302d-c8af-43d2-9b77-4394d2674961] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:48.552103 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:34:48.552103 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:34:48.554263 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8163e6ed-8a10-4fec-81c7-45a794e3bb5c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:48.554824 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8163e6ed-8a10-4fec-81c7-45a794e3bb5c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:48.563198 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8163e6ed-8a10-4fec-81c7-45a794e3bb5c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:48.563198 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8163e6ed-8a10-4fec-81c7-45a794e3bb5c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:48.563466 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-2c55e8b0-f8df-4964-852c-2c5901b53b0d req-f3e3bfb2-6df5-4a70-af1d-50b91f289c80 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:48.563466 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-2c55e8b0-f8df-4964-852c-2c5901b53b0d req-f3e3bfb2-6df5-4a70-af1d-50b91f289c80 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:48.600776 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-2c55e8b0-f8df-4964-852c-2c5901b53b0d req-f3e3bfb2-6df5-4a70-af1d-50b91f289c80 service nova] Creating event network-vif-deleted:85e667f2-845e-4e89-b387-1500b1f84677 for instance 11444b4c-e752-4766-9e89-f57974330390 on hv-cinder-84037 May 03 21:34:48.605880 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-2c55e8b0-f8df-4964-852c-2c5901b53b0d req-f3e3bfb2-6df5-4a70-af1d-50b91f289c80 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081433 May 03 21:34:48.606477 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 437/813] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:34:48.648476 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-8163e6ed-8a10-4fec-81c7-45a794e3bb5c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.114054 May 03 21:34:48.649311 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 377/814] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 3 21:34:48 2022] GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961/os-volume_attachments => generated 25 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 03 21:34:48.759489 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-c525b78b-45fe-4c26-a141-cdf6767b44d3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:48.760362 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-c525b78b-45fe-4c26-a141-cdf6767b44d3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 1233302d-c8af-43d2-9b77-4394d2674961] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:48.770571 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c525b78b-45fe-4c26-a141-cdf6767b44d3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:48.771236 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c525b78b-45fe-4c26-a141-cdf6767b44d3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:48.772415 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c525b78b-45fe-4c26-a141-cdf6767b44d3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:48.773097 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c525b78b-45fe-4c26-a141-cdf6767b44d3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:48.844523 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-c525b78b-45fe-4c26-a141-cdf6767b44d3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 1233302d-c8af-43d2-9b77-4394d2674961] Going to try to terminate instance {{(pid=97832) delete /opt/stack/nova/nova/compute/api.py:2559}} May 03 21:34:49.271096 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-c525b78b-45fe-4c26-a141-cdf6767b44d3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961" status: 204 len: 0 microversion: 2.1 time: 0.525719 May 03 21:34:49.271682 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 438/815] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 3 21:34:48 2022] DELETE /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 03 21:34:49.285169 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-59892902-2b20-4bd5-b0b7-256cc029f6f2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:49.285783 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-59892902-2b20-4bd5-b0b7-256cc029f6f2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 1233302d-c8af-43d2-9b77-4394d2674961] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:49.294347 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-59892902-2b20-4bd5-b0b7-256cc029f6f2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:49.294778 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-59892902-2b20-4bd5-b0b7-256cc029f6f2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:49.301311 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-59892902-2b20-4bd5-b0b7-256cc029f6f2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:49.301311 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-59892902-2b20-4bd5-b0b7-256cc029f6f2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:49.510918 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-59892902-2b20-4bd5-b0b7-256cc029f6f2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:49.520466 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-59892902-2b20-4bd5-b0b7-256cc029f6f2 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961" status: 200 len: 1679 microversion: 2.1 time: 0.244265 May 03 21:34:49.521143 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 378/816] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:49 2022] GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961 => generated 1679 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:49.550773 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-924f2004-ee2a-408e-b231-a4dda5689c77 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:49.551792 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-924f2004-ee2a-408e-b231-a4dda5689c77 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:49.559142 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-924f2004-ee2a-408e-b231-a4dda5689c77 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:49.559671 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-924f2004-ee2a-408e-b231-a4dda5689c77 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:49.560477 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-924f2004-ee2a-408e-b231-a4dda5689c77 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:49.560912 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-924f2004-ee2a-408e-b231-a4dda5689c77 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:49.643203 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-924f2004-ee2a-408e-b231-a4dda5689c77 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:49.643644 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-924f2004-ee2a-408e-b231-a4dda5689c77 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:49.644099 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.objects.instance [None req-924f2004-ee2a-408e-b231-a4dda5689c77 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lazy-loading 'fault' on Instance uuid 11444b4c-e752-4766-9e89-f57974330390 {{(pid=97832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 03 21:34:49.725949 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-924f2004-ee2a-408e-b231-a4dda5689c77 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:49.736125 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-924f2004-ee2a-408e-b231-a4dda5689c77 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 200 len: 1312 microversion: 2.1 time: 0.195217 May 03 21:34:49.736541 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 439/817] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:49 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 1312 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:50.546754 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-62060772-c0be-4504-9f86-2d53397d3ae1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:50.549071 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-62060772-c0be-4504-9f86-2d53397d3ae1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 1233302d-c8af-43d2-9b77-4394d2674961] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:50.557076 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-62060772-c0be-4504-9f86-2d53397d3ae1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:50.557542 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-62060772-c0be-4504-9f86-2d53397d3ae1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:50.558346 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-62060772-c0be-4504-9f86-2d53397d3ae1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:50.558791 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-62060772-c0be-4504-9f86-2d53397d3ae1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:50.765124 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-7ab72b70-0d78-4b75-a9a1-5cc4cddeb477 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:50.766777 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-7ab72b70-0d78-4b75-a9a1-5cc4cddeb477 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: 11444b4c-e752-4766-9e89-f57974330390] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:50.777758 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7ab72b70-0d78-4b75-a9a1-5cc4cddeb477 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:50.778338 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7ab72b70-0d78-4b75-a9a1-5cc4cddeb477 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:50.778967 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7ab72b70-0d78-4b75-a9a1-5cc4cddeb477 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:50.779394 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7ab72b70-0d78-4b75-a9a1-5cc4cddeb477 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:50.784810 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-62060772-c0be-4504-9f86-2d53397d3ae1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:50.798305 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-62060772-c0be-4504-9f86-2d53397d3ae1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961" status: 200 len: 1679 microversion: 2.1 time: 0.263748 May 03 21:34:50.810231 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 379/818] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:50 2022] GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961 => generated 1679 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:50.838509 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.wsgi [None req-7ab72b70-0d78-4b75-a9a1-5cc4cddeb477 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] HTTP exception thrown: Instance 11444b4c-e752-4766-9e89-f57974330390 could not be found. May 03 21:34:50.839108 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-7ab72b70-0d78-4b75-a9a1-5cc4cddeb477 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Returning 404 to user: Instance 11444b4c-e752-4766-9e89-f57974330390 could not be found. {{(pid=97832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:34:50.840220 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-7ab72b70-0d78-4b75-a9a1-5cc4cddeb477 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390" status: 404 len: 111 microversion: 2.1 time: 0.085609 May 03 21:34:50.841895 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 440/819] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:50 2022] GET /compute/v2.1/servers/11444b4c-e752-4766-9e89-f57974330390 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 21:34:50.854637 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-d6ed9229-e192-4f32-81b3-0612511da719 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:50.855702 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-d6ed9229-e192-4f32-81b3-0612511da719 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:50.862634 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d6ed9229-e192-4f32-81b3-0612511da719 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:50.863096 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d6ed9229-e192-4f32-81b3-0612511da719 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:50.863869 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d6ed9229-e192-4f32-81b3-0612511da719 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:50.864594 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d6ed9229-e192-4f32-81b3-0612511da719 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:50.936042 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-d6ed9229-e192-4f32-81b3-0612511da719 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Going to try to terminate instance {{(pid=97831) delete /opt/stack/nova/nova/compute/api.py:2559}} May 03 21:34:51.378949 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-d6ed9229-e192-4f32-81b3-0612511da719 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9" status: 204 len: 0 microversion: 2.1 time: 0.533180 May 03 21:34:51.379704 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 380/820] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 3 21:34:50 2022] DELETE /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 03 21:34:51.393440 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-c406c498-3f79-4fe5-9c04-78093c10ebd6 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:51.394098 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-c406c498-3f79-4fe5-9c04-78093c10ebd6 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:51.401590 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c406c498-3f79-4fe5-9c04-78093c10ebd6 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:51.402040 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c406c498-3f79-4fe5-9c04-78093c10ebd6 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:51.402821 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c406c498-3f79-4fe5-9c04-78093c10ebd6 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:51.403284 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c406c498-3f79-4fe5-9c04-78093c10ebd6 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:51.632539 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-c406c498-3f79-4fe5-9c04-78093c10ebd6 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:51.645512 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-c406c498-3f79-4fe5-9c04-78093c10ebd6 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9" status: 200 len: 1522 microversion: 2.1 time: 0.261373 May 03 21:34:51.650918 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 441/821] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:51 2022] GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9 => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:51.824768 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-a56e6de9-5a1b-4d89-a9f4-62715c067625 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:51.825479 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-a56e6de9-5a1b-4d89-a9f4-62715c067625 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 1233302d-c8af-43d2-9b77-4394d2674961] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:51.833401 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a56e6de9-5a1b-4d89-a9f4-62715c067625 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:51.833905 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a56e6de9-5a1b-4d89-a9f4-62715c067625 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:51.835087 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a56e6de9-5a1b-4d89-a9f4-62715c067625 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:51.835526 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a56e6de9-5a1b-4d89-a9f4-62715c067625 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:52.357192 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-a56e6de9-5a1b-4d89-a9f4-62715c067625 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:52.367447 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-a56e6de9-5a1b-4d89-a9f4-62715c067625 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961" status: 200 len: 1679 microversion: 2.1 time: 0.552617 May 03 21:34:52.368245 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 381/822] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:51 2022] GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961 => generated 1679 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:52.686684 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-816f15b0-2178-4454-bbb5-1f1ef138975d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:52.688946 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-816f15b0-2178-4454-bbb5-1f1ef138975d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:52.699972 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-816f15b0-2178-4454-bbb5-1f1ef138975d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:52.700439 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-816f15b0-2178-4454-bbb5-1f1ef138975d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:52.702241 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-816f15b0-2178-4454-bbb5-1f1ef138975d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:52.702689 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-816f15b0-2178-4454-bbb5-1f1ef138975d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:52.937016 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-816f15b0-2178-4454-bbb5-1f1ef138975d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:52.946239 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-816f15b0-2178-4454-bbb5-1f1ef138975d tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9" status: 200 len: 1522 microversion: 2.1 time: 0.282046 May 03 21:34:52.947043 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 442/823] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:52 2022] GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:53.395972 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-cfcc4f39-6a09-4043-b70e-199b9ca1af29 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:53.397300 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-cfcc4f39-6a09-4043-b70e-199b9ca1af29 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 1233302d-c8af-43d2-9b77-4394d2674961] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:53.423182 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-cfcc4f39-6a09-4043-b70e-199b9ca1af29 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:53.425963 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-cfcc4f39-6a09-4043-b70e-199b9ca1af29 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:53.432339 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-cfcc4f39-6a09-4043-b70e-199b9ca1af29 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:53.432339 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-cfcc4f39-6a09-4043-b70e-199b9ca1af29 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:53.525504 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-459f257d-3e50-4d8a-a179-6868b10083dc req-104b8c3d-352d-4161-aa09-c5692e8fbc7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1233302d-c8af-43d2-9b77-4394d2674961", "name": "network-vif-deleted", "tag": "7fa6b06a-f0cf-4a54-8f74-c95315afe030"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:34:53.535107 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:34:53.535107 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:34:53.545882 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-459f257d-3e50-4d8a-a179-6868b10083dc req-104b8c3d-352d-4161-aa09-c5692e8fbc7d service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:53.546384 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-459f257d-3e50-4d8a-a179-6868b10083dc req-104b8c3d-352d-4161-aa09-c5692e8fbc7d service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:53.570197 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-459f257d-3e50-4d8a-a179-6868b10083dc req-104b8c3d-352d-4161-aa09-c5692e8fbc7d service nova] Creating event network-vif-deleted:7fa6b06a-f0cf-4a54-8f74-c95315afe030 for instance 1233302d-c8af-43d2-9b77-4394d2674961 on hv-cinder-84037 May 03 21:34:53.576157 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-459f257d-3e50-4d8a-a179-6868b10083dc req-104b8c3d-352d-4161-aa09-c5692e8fbc7d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064494 May 03 21:34:53.577229 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 443/824] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:34:53.812893 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-cfcc4f39-6a09-4043-b70e-199b9ca1af29 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:53.830030 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-cfcc4f39-6a09-4043-b70e-199b9ca1af29 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961" status: 200 len: 1612 microversion: 2.1 time: 0.447092 May 03 21:34:53.831520 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 382/825] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:53 2022] GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961 => generated 1612 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:53.980573 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-e4ddf0e2-dd7d-472c-ac21-94ca3833e986 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:53.995751 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-e4ddf0e2-dd7d-472c-ac21-94ca3833e986 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:54.017867 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e4ddf0e2-dd7d-472c-ac21-94ca3833e986 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:54.018567 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e4ddf0e2-dd7d-472c-ac21-94ca3833e986 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:54.022851 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e4ddf0e2-dd7d-472c-ac21-94ca3833e986 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:54.022851 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e4ddf0e2-dd7d-472c-ac21-94ca3833e986 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:54.305921 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-e4ddf0e2-dd7d-472c-ac21-94ca3833e986 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:54.317018 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-e4ddf0e2-dd7d-472c-ac21-94ca3833e986 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9" status: 200 len: 1522 microversion: 2.1 time: 0.352429 May 03 21:34:54.318162 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 444/826] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:53 2022] GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9 => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:54.853339 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-6f460a24-0100-4a32-a425-2a5363c57db3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:54.855019 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-6f460a24-0100-4a32-a425-2a5363c57db3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 1233302d-c8af-43d2-9b77-4394d2674961] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:54.865171 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6f460a24-0100-4a32-a425-2a5363c57db3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:54.865672 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6f460a24-0100-4a32-a425-2a5363c57db3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:54.867231 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6f460a24-0100-4a32-a425-2a5363c57db3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:54.868171 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6f460a24-0100-4a32-a425-2a5363c57db3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:54.955743 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6f460a24-0100-4a32-a425-2a5363c57db3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:54.956416 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6f460a24-0100-4a32-a425-2a5363c57db3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:54.956894 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.objects.instance [None req-6f460a24-0100-4a32-a425-2a5363c57db3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lazy-loading 'fault' on Instance uuid 1233302d-c8af-43d2-9b77-4394d2674961 {{(pid=97831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 03 21:34:55.114435 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-6f460a24-0100-4a32-a425-2a5363c57db3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:55.127841 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-6f460a24-0100-4a32-a425-2a5363c57db3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961" status: 200 len: 1332 microversion: 2.1 time: 0.284488 May 03 21:34:55.128395 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 383/827] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:54 2022] GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961 => generated 1332 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:55.341734 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-29936cec-83e3-497a-9123-14ee8fe99359 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:55.342399 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-29936cec-83e3-497a-9123-14ee8fe99359 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:55.351888 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-29936cec-83e3-497a-9123-14ee8fe99359 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:55.352601 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-29936cec-83e3-497a-9123-14ee8fe99359 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:55.353498 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-29936cec-83e3-497a-9123-14ee8fe99359 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:55.354321 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-29936cec-83e3-497a-9123-14ee8fe99359 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:55.588715 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-29936cec-83e3-497a-9123-14ee8fe99359 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:55.599052 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-29936cec-83e3-497a-9123-14ee8fe99359 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9" status: 200 len: 1522 microversion: 2.1 time: 0.267709 May 03 21:34:55.599816 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 445/828] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:55 2022] GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:55.711443 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-9afb1ae5-f886-483f-847a-895378215341 req-5d5f74d9-3e63-4c95-9331-af5e837ae7ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dffdb65a-4c55-4f89-afd3-ff88a82805d9", "name": "network-vif-deleted", "tag": "703e14ee-54de-44ea-bfca-17283964e8b4"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:34:55.718194 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:34:55.718194 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:34:55.727142 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-9afb1ae5-f886-483f-847a-895378215341 req-5d5f74d9-3e63-4c95-9331-af5e837ae7ca service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:55.727594 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-9afb1ae5-f886-483f-847a-895378215341 req-5d5f74d9-3e63-4c95-9331-af5e837ae7ca service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:55.744385 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-9afb1ae5-f886-483f-847a-895378215341 req-5d5f74d9-3e63-4c95-9331-af5e837ae7ca service nova] Creating event network-vif-deleted:703e14ee-54de-44ea-bfca-17283964e8b4 for instance dffdb65a-4c55-4f89-afd3-ff88a82805d9 on hv-cinder-84037 May 03 21:34:55.750348 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-9afb1ae5-f886-483f-847a-895378215341 req-5d5f74d9-3e63-4c95-9331-af5e837ae7ca service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050734 May 03 21:34:55.750941 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 384/829] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:34:56.153686 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-cd3a4e38-2caa-4ef6-a8e4-3fe97cd5a606 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:56.154428 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-cd3a4e38-2caa-4ef6-a8e4-3fe97cd5a606 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 1233302d-c8af-43d2-9b77-4394d2674961] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:56.162128 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cd3a4e38-2caa-4ef6-a8e4-3fe97cd5a606 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:56.162669 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cd3a4e38-2caa-4ef6-a8e4-3fe97cd5a606 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:56.165097 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cd3a4e38-2caa-4ef6-a8e4-3fe97cd5a606 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:56.165097 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cd3a4e38-2caa-4ef6-a8e4-3fe97cd5a606 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:56.217889 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.wsgi [None req-cd3a4e38-2caa-4ef6-a8e4-3fe97cd5a606 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] HTTP exception thrown: Instance 1233302d-c8af-43d2-9b77-4394d2674961 could not be found. May 03 21:34:56.218448 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-cd3a4e38-2caa-4ef6-a8e4-3fe97cd5a606 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Returning 404 to user: Instance 1233302d-c8af-43d2-9b77-4394d2674961 could not be found. {{(pid=97832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:34:56.219421 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-cd3a4e38-2caa-4ef6-a8e4-3fe97cd5a606 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961" status: 404 len: 111 microversion: 2.1 time: 0.074996 May 03 21:34:56.219873 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 446/830] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:56 2022] GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 21:34:56.234785 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-37f8219b-1867-4658-b664-08f97bfe14f7 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '.version_select at 0x7fc84cd92550>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:56.338902 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-37f8219b-1867-4658-b664-08f97bfe14f7 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1237756290" status: 202 len: 0 microversion: 2.1 time: 0.114189 May 03 21:34:56.343607 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 385/831] 10.222.0.48 () {58 vars in 1220 bytes} [Tue May 3 21:34:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1237756290 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 21:34:56.622178 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-71f21000-3aa1-4075-9180-7ec0e5d5aa30 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:56.622796 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-71f21000-3aa1-4075-9180-7ec0e5d5aa30 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:56.630869 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-71f21000-3aa1-4075-9180-7ec0e5d5aa30 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:56.631314 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-71f21000-3aa1-4075-9180-7ec0e5d5aa30 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:56.632183 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-71f21000-3aa1-4075-9180-7ec0e5d5aa30 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:56.632648 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-71f21000-3aa1-4075-9180-7ec0e5d5aa30 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:56.712915 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-71f21000-3aa1-4075-9180-7ec0e5d5aa30 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:56.713302 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-71f21000-3aa1-4075-9180-7ec0e5d5aa30 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:56.713755 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.objects.instance [None req-71f21000-3aa1-4075-9180-7ec0e5d5aa30 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lazy-loading 'fault' on Instance uuid dffdb65a-4c55-4f89-afd3-ff88a82805d9 {{(pid=97832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 03 21:34:56.773840 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-71f21000-3aa1-4075-9180-7ec0e5d5aa30 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a12cc655c2c404e928b2e1bb44c64e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30468ebc688d4bc1b036b4b984931e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:34:56.782615 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-71f21000-3aa1-4075-9180-7ec0e5d5aa30 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9" status: 200 len: 1311 microversion: 2.1 time: 0.170183 May 03 21:34:56.783142 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 447/832] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:56 2022] GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9 => generated 1311 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:57.805947 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-d4990178-844d-4c36-bac0-b7b730392438 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:34:57.806773 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-d4990178-844d-4c36-bac0-b7b730392438 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] [instance: dffdb65a-4c55-4f89-afd3-ff88a82805d9] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:34:57.815555 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d4990178-844d-4c36-bac0-b7b730392438 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:57.816102 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d4990178-844d-4c36-bac0-b7b730392438 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:57.816989 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d4990178-844d-4c36-bac0-b7b730392438 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:34:57.817518 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d4990178-844d-4c36-bac0-b7b730392438 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:34:57.865387 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-41cbaf2e-f23a-4552-abad-c1c364305c46 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Action: 'create', calling method: .version_select at 0x7fc84cc10b80>, body: {"keypair": {"name": "tempest-keypair-1472811381"}} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:34:57.871147 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.wsgi [None req-d4990178-844d-4c36-bac0-b7b730392438 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] HTTP exception thrown: Instance dffdb65a-4c55-4f89-afd3-ff88a82805d9 could not be found. May 03 21:34:57.871821 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-d4990178-844d-4c36-bac0-b7b730392438 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] Returning 404 to user: Instance dffdb65a-4c55-4f89-afd3-ff88a82805d9 could not be found. {{(pid=97831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:34:57.872676 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-d4990178-844d-4c36-bac0-b7b730392438 tempest-ServerRescueNegativeTestJSON-1780361836 tempest-ServerRescueNegativeTestJSON-1780361836-project] 10.222.0.48 "GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9" status: 404 len: 111 microversion: 2.1 time: 0.076855 May 03 21:34:57.873537 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 386/833] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:34:57 2022] GET /compute/v2.1/servers/dffdb65a-4c55-4f89-afd3-ff88a82805d9 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 21:34:57.902009 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-41cbaf2e-f23a-4552-abad-c1c364305c46 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Getting quotas for project bd571e41b44a4bc6b16bf8163252f168. Resources: {'key_pairs'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:34:57.906114 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-41cbaf2e-f23a-4552-abad-c1c364305c46 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Getting quotas for user c2fe2da4d72e4522ac8bbb7c9a58381a and project bd571e41b44a4bc6b16bf8163252f168. Resources: {'key_pairs'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:34:58.503395 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-41cbaf2e-f23a-4552-abad-c1c364305c46 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Getting quotas for project bd571e41b44a4bc6b16bf8163252f168. Resources: {'key_pairs'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:34:58.507162 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-41cbaf2e-f23a-4552-abad-c1c364305c46 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Getting quotas for user c2fe2da4d72e4522ac8bbb7c9a58381a and project bd571e41b44a4bc6b16bf8163252f168. Resources: {'key_pairs'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:34:58.522664 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-41cbaf2e-f23a-4552-abad-c1c364305c46 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.668410 May 03 21:34:58.523535 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 448/834] 10.222.0.48 () {60 vars in 1157 bytes} [Tue May 3 21:34:57 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:34:59.971185 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-0c1691d1-d0a7-42c5-82f0-3708f42c2a91 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-922283733", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-103237313", "security_groups": [{"name": "tempest-secgroup-smoke-1580700779"}], "block_device_mapping_v2": [{"uuid": "5586d533-5d7b-478e-a810-2d5d0c485260", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f0a9fce1-0034-4c9f-bab5-3584af0c3657"}]}} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:35:00.148058 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.network.neutron [None req-0c1691d1-d0a7-42c5-82f0-3708f42c2a91 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] validate_networks() for [('f0a9fce1-0034-4c9f-bab5-3584af0c3657', None, None, None)] {{(pid=97831) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} May 03 21:35:00.807815 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-0c1691d1-d0a7-42c5-82f0-3708f42c2a91 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Flavor limits 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} May 03 21:35:00.808240 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-0c1691d1-d0a7-42c5-82f0-3708f42c2a91 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Image limits 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} May 03 21:35:00.808796 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-0c1691d1-d0a7-42c5-82f0-3708f42c2a91 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Flavor pref 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} May 03 21:35:00.809229 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-0c1691d1-d0a7-42c5-82f0-3708f42c2a91 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Image pref 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} May 03 21:35:00.809636 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-0c1691d1-d0a7-42c5-82f0-3708f42c2a91 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} May 03 21:35:00.820096 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0c1691d1-d0a7-42c5-82f0-3708f42c2a91 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:00.820814 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0c1691d1-d0a7-42c5-82f0-3708f42c2a91 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:00.821827 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0c1691d1-d0a7-42c5-82f0-3708f42c2a91 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:00.822267 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0c1691d1-d0a7-42c5-82f0-3708f42c2a91 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:00.841752 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-0c1691d1-d0a7-42c5-82f0-3708f42c2a91 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Getting quotas for project e665d5aad2c24ad7843ca060d41792d3. Resources: {'instances', 'ram', 'cores'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:35:00.846954 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-0c1691d1-d0a7-42c5-82f0-3708f42c2a91 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Getting quotas for user 2873b6c651a94d4992d0debcab8aeafd and project e665d5aad2c24ad7843ca060d41792d3. Resources: {'instances', 'ram', 'cores'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:35:00.947392 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-0c1691d1-d0a7-42c5-82f0-3708f42c2a91 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Going to run 1 instances... {{(pid=97831) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} May 03 21:35:00.949700 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-0c1691d1-d0a7-42c5-82f0-3708f42c2a91 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 4e3930f0-3a9f-4d20-ae74-434e66c18c46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5586d533-5d7b-478e-a810-2d5d0c485260',volume_size=None,volume_type=None)] {{(pid=97831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} May 03 21:35:01.455993 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-0c1691d1-d0a7-42c5-82f0-3708f42c2a91 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.493938 May 03 21:35:01.463676 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 387/835] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 3 21:34:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 1502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 03 21:35:01.474784 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-35b6ced6-6839-4865-a9d9-f0160fc9f84f tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:01.482267 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-35b6ced6-6839-4865-a9d9-f0160fc9f84f tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 4e3930f0-3a9f-4d20-ae74-434e66c18c46] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:01.976258 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-35b6ced6-6839-4865-a9d9-f0160fc9f84f tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:01.983688 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-35b6ced6-6839-4865-a9d9-f0160fc9f84f tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46" status: 200 len: 1093 microversion: 2.1 time: 0.518978 May 03 21:35:01.985035 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 449/836] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:01 2022] GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46 => generated 1093 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:35:03.007923 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-1f778a38-8a4e-4790-a9da-65c685a5deb9 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:03.008641 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-1f778a38-8a4e-4790-a9da-65c685a5deb9 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 4e3930f0-3a9f-4d20-ae74-434e66c18c46] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:03.018180 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1f778a38-8a4e-4790-a9da-65c685a5deb9 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:03.018622 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1f778a38-8a4e-4790-a9da-65c685a5deb9 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:03.019396 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1f778a38-8a4e-4790-a9da-65c685a5deb9 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:03.019824 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1f778a38-8a4e-4790-a9da-65c685a5deb9 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:03.149900 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-1f778a38-8a4e-4790-a9da-65c685a5deb9 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:03.159893 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-1f778a38-8a4e-4790-a9da-65c685a5deb9 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46" status: 200 len: 1143 microversion: 2.1 time: 0.162021 May 03 21:35:03.160399 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 388/837] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:02 2022] GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46 => generated 1143 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:35:03.510816 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-ff75e9cf-d7c2-4638-ab63-6efab7b74201 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:03.511569 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-ff75e9cf-d7c2-4638-ab63-6efab7b74201 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:03.521342 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ff75e9cf-d7c2-4638-ab63-6efab7b74201 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:03.521797 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ff75e9cf-d7c2-4638-ab63-6efab7b74201 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:03.522579 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ff75e9cf-d7c2-4638-ab63-6efab7b74201 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:03.523007 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ff75e9cf-d7c2-4638-ab63-6efab7b74201 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:03.594991 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-ff75e9cf-d7c2-4638-ab63-6efab7b74201 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469/ips" status: 200 len: 151 microversion: 2.20 time: 0.092455 May 03 21:35:03.595644 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 450/838] 10.222.0.48 () {60 vars in 1288 bytes} [Tue May 3 21:35:03 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469/ips => generated 151 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 03 21:35:03.792159 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-8f7a4cf7-9f3c-4fac-9216-9bec04bf6032 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-688014289", "imageRef": "f5214328-64f1-4aa6-aa05-61f0189e0e1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "afa29ce3-7ea1-4fb3-8d15-b28913382476"}], "security_groups": [{"name": "tempest-securitygroup--909238419"}], "key_name": "tempest-keypair-1472811381", "user_data": "}} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:35:04.036469 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.network.neutron [None req-8f7a4cf7-9f3c-4fac-9216-9bec04bf6032 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] validate_networks() for [('afa29ce3-7ea1-4fb3-8d15-b28913382476', None, None, None)] {{(pid=97831) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} May 03 21:35:04.182709 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-04bfba8b-b514-494a-961d-d81d52f37c04 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:04.186036 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-04bfba8b-b514-494a-961d-d81d52f37c04 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 4e3930f0-3a9f-4d20-ae74-434e66c18c46] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:04.193925 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-04bfba8b-b514-494a-961d-d81d52f37c04 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:04.197495 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-04bfba8b-b514-494a-961d-d81d52f37c04 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:04.197495 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-04bfba8b-b514-494a-961d-d81d52f37c04 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:04.197495 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-04bfba8b-b514-494a-961d-d81d52f37c04 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:04.381476 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-04bfba8b-b514-494a-961d-d81d52f37c04 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:04.390827 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-04bfba8b-b514-494a-961d-d81d52f37c04 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46" status: 200 len: 1191 microversion: 2.1 time: 0.216825 May 03 21:35:04.391380 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 451/839] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:04 2022] GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46 => generated 1191 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:35:04.835879 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-8f7a4cf7-9f3c-4fac-9216-9bec04bf6032 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Flavor limits 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} May 03 21:35:04.837342 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-8f7a4cf7-9f3c-4fac-9216-9bec04bf6032 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Image limits 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} May 03 21:35:04.838494 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-8f7a4cf7-9f3c-4fac-9216-9bec04bf6032 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Flavor pref 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} May 03 21:35:04.839212 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-8f7a4cf7-9f3c-4fac-9216-9bec04bf6032 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Image pref 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} May 03 21:35:04.839772 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-8f7a4cf7-9f3c-4fac-9216-9bec04bf6032 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} May 03 21:35:04.851457 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8f7a4cf7-9f3c-4fac-9216-9bec04bf6032 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:04.851903 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8f7a4cf7-9f3c-4fac-9216-9bec04bf6032 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:04.852778 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8f7a4cf7-9f3c-4fac-9216-9bec04bf6032 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:04.853944 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8f7a4cf7-9f3c-4fac-9216-9bec04bf6032 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:04.875169 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-8f7a4cf7-9f3c-4fac-9216-9bec04bf6032 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Getting quotas for project bd571e41b44a4bc6b16bf8163252f168. Resources: {'instances', 'ram', 'cores'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:35:04.879468 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-8f7a4cf7-9f3c-4fac-9216-9bec04bf6032 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Getting quotas for user c2fe2da4d72e4522ac8bbb7c9a58381a and project bd571e41b44a4bc6b16bf8163252f168. Resources: {'instances', 'ram', 'cores'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:35:04.899243 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-8f7a4cf7-9f3c-4fac-9216-9bec04bf6032 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Going to run 1 instances... {{(pid=97831) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} May 03 21:35:04.900401 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-8f7a4cf7-9f3c-4fac-9216-9bec04bf6032 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: c8f9aa7c-153d-482a-b048-18cd034d21cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5214328-64f1-4aa6-aa05-61f0189e0e1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=97831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} May 03 21:35:05.050077 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-8f7a4cf7-9f3c-4fac-9216-9bec04bf6032 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.273335 May 03 21:35:05.056005 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 389/840] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 3 21:35:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 1280 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 03 21:35:05.067041 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-c79f8660-55a1-448a-840c-b3ece3e41c87 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:05.067925 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-c79f8660-55a1-448a-840c-b3ece3e41c87 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: c8f9aa7c-153d-482a-b048-18cd034d21cb] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:05.194426 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-c79f8660-55a1-448a-840c-b3ece3e41c87 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:05.218701 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-c79f8660-55a1-448a-840c-b3ece3e41c87 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb" status: 200 len: 1241 microversion: 2.1 time: 0.160297 May 03 21:35:05.220477 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 452/841] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:05 2022] GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb => generated 1241 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:35:05.414653 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-fbc30f58-7a68-4a0c-8278-e5cf6d4b77ef tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:05.415363 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-fbc30f58-7a68-4a0c-8278-e5cf6d4b77ef tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 4e3930f0-3a9f-4d20-ae74-434e66c18c46] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:05.425031 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fbc30f58-7a68-4a0c-8278-e5cf6d4b77ef tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:05.425496 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fbc30f58-7a68-4a0c-8278-e5cf6d4b77ef tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:05.426388 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fbc30f58-7a68-4a0c-8278-e5cf6d4b77ef tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:05.426993 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fbc30f58-7a68-4a0c-8278-e5cf6d4b77ef tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:05.646379 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-fbc30f58-7a68-4a0c-8278-e5cf6d4b77ef tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:05.656767 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-fbc30f58-7a68-4a0c-8278-e5cf6d4b77ef tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46" status: 200 len: 1209 microversion: 2.1 time: 0.252851 May 03 21:35:05.657515 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 390/842] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:05 2022] GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46 => generated 1209 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:35:06.255321 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-5ca55382-308a-4d92-95b5-490d2333caf6 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:06.256110 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-5ca55382-308a-4d92-95b5-490d2333caf6 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: c8f9aa7c-153d-482a-b048-18cd034d21cb] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:06.276917 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-b33712f0-2ae6-4296-a282-f50eb39614ad tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:35:06.280808 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-b33712f0-2ae6-4296-a282-f50eb39614ad tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:06.296902 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b33712f0-2ae6-4296-a282-f50eb39614ad tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:06.297779 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b33712f0-2ae6-4296-a282-f50eb39614ad tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:06.301462 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b33712f0-2ae6-4296-a282-f50eb39614ad tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:06.301462 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b33712f0-2ae6-4296-a282-f50eb39614ad tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:06.372304 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-5ca55382-308a-4d92-95b5-490d2333caf6 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:06.389340 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-5ca55382-308a-4d92-95b5-490d2333caf6 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb" status: 200 len: 1241 microversion: 2.1 time: 0.155162 May 03 21:35:06.390855 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 453/843] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:06 2022] GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb => generated 1241 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:35:06.411560 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.objects.instance [None req-b33712f0-2ae6-4296-a282-f50eb39614ad tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lazy-loading 'flavor' on Instance uuid 49b86a80-657d-4e94-bc71-bcfe8f276469 {{(pid=97831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 03 21:35:06.685505 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-2ebb5cbe-fbdd-4346-a14e-2b104c48573d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:06.687674 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-2ebb5cbe-fbdd-4346-a14e-2b104c48573d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 4e3930f0-3a9f-4d20-ae74-434e66c18c46] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:06.702026 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2ebb5cbe-fbdd-4346-a14e-2b104c48573d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:06.702744 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2ebb5cbe-fbdd-4346-a14e-2b104c48573d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:06.705657 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2ebb5cbe-fbdd-4346-a14e-2b104c48573d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:06.706831 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2ebb5cbe-fbdd-4346-a14e-2b104c48573d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:06.877575 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-2ebb5cbe-fbdd-4346-a14e-2b104c48573d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:06.887138 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-2ebb5cbe-fbdd-4346-a14e-2b104c48573d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46" status: 200 len: 1209 microversion: 2.1 time: 0.215313 May 03 21:35:06.889164 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 454/844] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:06 2022] GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46 => generated 1209 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:35:07.417657 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-ec100ad4-d01d-4dfe-a825-a0a436c54df7 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:07.419198 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-ec100ad4-d01d-4dfe-a825-a0a436c54df7 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: c8f9aa7c-153d-482a-b048-18cd034d21cb] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:07.420016 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-b33712f0-2ae6-4296-a282-f50eb39614ad tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "POST /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469/action" status: 202 len: 0 microversion: 2.20 time: 1.180570 May 03 21:35:07.420687 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 391/845] 10.222.0.48 () {62 vars in 1318 bytes} [Tue May 3 21:35:06 2022] POST /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469/action => generated 0 bytes in 1184 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 03 21:35:07.429332 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ec100ad4-d01d-4dfe-a825-a0a436c54df7 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:07.429849 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ec100ad4-d01d-4dfe-a825-a0a436c54df7 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:07.430831 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ec100ad4-d01d-4dfe-a825-a0a436c54df7 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:07.431417 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ec100ad4-d01d-4dfe-a825-a0a436c54df7 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:07.449599 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-cdf998c5-f4c3-4338-9cdc-cc09baefded6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:07.450655 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-cdf998c5-f4c3-4338-9cdc-cc09baefded6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:07.461925 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-cdf998c5-f4c3-4338-9cdc-cc09baefded6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:07.462729 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-cdf998c5-f4c3-4338-9cdc-cc09baefded6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:07.463641 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-cdf998c5-f4c3-4338-9cdc-cc09baefded6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:07.464094 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-cdf998c5-f4c3-4338-9cdc-cc09baefded6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:07.582347 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-ec100ad4-d01d-4dfe-a825-a0a436c54df7 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:07.595131 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-ec100ad4-d01d-4dfe-a825-a0a436c54df7 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb" status: 200 len: 1237 microversion: 2.1 time: 0.187546 May 03 21:35:07.601064 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 455/846] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:07 2022] GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb => generated 1237 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:35:07.912346 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-d48b4e37-b8b1-424a-b968-557aca1f26cb tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:07.913038 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-d48b4e37-b8b1-424a-b968-557aca1f26cb tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 4e3930f0-3a9f-4d20-ae74-434e66c18c46] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:07.921133 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d48b4e37-b8b1-424a-b968-557aca1f26cb tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:07.921736 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d48b4e37-b8b1-424a-b968-557aca1f26cb tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:07.922845 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d48b4e37-b8b1-424a-b968-557aca1f26cb tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:07.923285 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d48b4e37-b8b1-424a-b968-557aca1f26cb tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:08.278253 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-d48b4e37-b8b1-424a-b968-557aca1f26cb tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:08.287448 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-d48b4e37-b8b1-424a-b968-557aca1f26cb tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46" status: 200 len: 1265 microversion: 2.1 time: 0.385230 May 03 21:35:08.288075 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 456/847] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:07 2022] GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46 => generated 1265 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:35:08.316743 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-cdf998c5-f4c3-4338-9cdc-cc09baefded6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:08.331076 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-cdf998c5-f4c3-4338-9cdc-cc09baefded6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:08.337621 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-cdf998c5-f4c3-4338-9cdc-cc09baefded6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:08.347533 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-cdf998c5-f4c3-4338-9cdc-cc09baefded6 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1723 microversion: 2.20 time: 0.913406 May 03 21:35:08.347533 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 392/848] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:35:07 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1723 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 21:35:08.618815 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-80ac8e1a-c88b-47cb-b008-b84a32c6ed8d tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:08.619628 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-80ac8e1a-c88b-47cb-b008-b84a32c6ed8d tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: c8f9aa7c-153d-482a-b048-18cd034d21cb] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:08.634156 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-80ac8e1a-c88b-47cb-b008-b84a32c6ed8d tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:08.634680 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-80ac8e1a-c88b-47cb-b008-b84a32c6ed8d tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:08.635465 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-80ac8e1a-c88b-47cb-b008-b84a32c6ed8d tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:08.636067 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-80ac8e1a-c88b-47cb-b008-b84a32c6ed8d tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:08.772886 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-80ac8e1a-c88b-47cb-b008-b84a32c6ed8d tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:08.782282 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-80ac8e1a-c88b-47cb-b008-b84a32c6ed8d tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb" status: 200 len: 1301 microversion: 2.1 time: 0.173794 May 03 21:35:08.784314 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 457/849] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:08 2022] GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb => generated 1301 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:35:09.318788 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-e26c9653-bf43-417b-8423-43bd85fb533a tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:09.319949 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-e26c9653-bf43-417b-8423-43bd85fb533a tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 4e3930f0-3a9f-4d20-ae74-434e66c18c46] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:09.328270 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e26c9653-bf43-417b-8423-43bd85fb533a tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:09.328752 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e26c9653-bf43-417b-8423-43bd85fb533a tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:09.329740 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e26c9653-bf43-417b-8423-43bd85fb533a tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:09.330283 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e26c9653-bf43-417b-8423-43bd85fb533a tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:09.364961 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-cfea06f0-38e6-4e37-b334-097d0be51dde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:09.368253 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-cfea06f0-38e6-4e37-b334-097d0be51dde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:09.383324 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cfea06f0-38e6-4e37-b334-097d0be51dde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:09.383786 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cfea06f0-38e6-4e37-b334-097d0be51dde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:09.384668 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cfea06f0-38e6-4e37-b334-097d0be51dde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:09.385280 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cfea06f0-38e6-4e37-b334-097d0be51dde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:09.818118 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-cfea06f0-38e6-4e37-b334-097d0be51dde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:09.833361 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-cfea06f0-38e6-4e37-b334-097d0be51dde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:09.839866 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-cfea06f0-38e6-4e37-b334-097d0be51dde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:09.841036 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-cfea06f0-38e6-4e37-b334-097d0be51dde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1723 microversion: 2.20 time: 0.486445 May 03 21:35:09.848610 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 458/850] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:35:09 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1723 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:35:09.853199 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-be749807-fb0c-436f-957d-e89d65cfefc9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:09.853818 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-be749807-fb0c-436f-957d-e89d65cfefc9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: c8f9aa7c-153d-482a-b048-18cd034d21cb] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:09.862653 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-be749807-fb0c-436f-957d-e89d65cfefc9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:09.863097 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-be749807-fb0c-436f-957d-e89d65cfefc9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:09.863870 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-be749807-fb0c-436f-957d-e89d65cfefc9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:09.864296 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-be749807-fb0c-436f-957d-e89d65cfefc9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:10.034750 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-be749807-fb0c-436f-957d-e89d65cfefc9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:10.044700 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-be749807-fb0c-436f-957d-e89d65cfefc9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb" status: 200 len: 1299 microversion: 2.1 time: 0.201797 May 03 21:35:10.046882 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 459/851] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:09 2022] GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb => generated 1299 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:35:10.058240 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-9d08a94b-fadc-4044-86cb-d978e1a0f367 req-9d38f12c-0db5-45d7-a487-e985a668b433 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e3930f0-3a9f-4d20-ae74-434e66c18c46", "tag": "d3860f2c-7b5b-47b1-89e7-e6eac5582cd6"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:35:10.066998 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:35:10.066998 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:35:10.078312 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-9d08a94b-fadc-4044-86cb-d978e1a0f367 req-9d38f12c-0db5-45d7-a487-e985a668b433 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:10.079042 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-9d08a94b-fadc-4044-86cb-d978e1a0f367 req-9d38f12c-0db5-45d7-a487-e985a668b433 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:10.099121 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-9d08a94b-fadc-4044-86cb-d978e1a0f367 req-9d38f12c-0db5-45d7-a487-e985a668b433 service nova] Creating event network-changed:d3860f2c-7b5b-47b1-89e7-e6eac5582cd6 for instance 4e3930f0-3a9f-4d20-ae74-434e66c18c46 on hv-cinder-84037 May 03 21:35:10.104156 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-9d08a94b-fadc-4044-86cb-d978e1a0f367 req-9d38f12c-0db5-45d7-a487-e985a668b433 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055695 May 03 21:35:10.105114 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 460/852] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:35:10.254982 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-e26c9653-bf43-417b-8423-43bd85fb533a tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:10.263369 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-e26c9653-bf43-417b-8423-43bd85fb533a tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46" status: 200 len: 1265 microversion: 2.1 time: 0.961846 May 03 21:35:10.264503 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 393/853] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:09 2022] GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46 => generated 1265 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:35:10.867174 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-f5ee65db-723e-42e0-8678-c94f0e8b2442 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:10.867990 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-f5ee65db-723e-42e0-8678-c94f0e8b2442 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:10.876620 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f5ee65db-723e-42e0-8678-c94f0e8b2442 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:10.877075 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f5ee65db-723e-42e0-8678-c94f0e8b2442 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:10.877857 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f5ee65db-723e-42e0-8678-c94f0e8b2442 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:10.878300 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f5ee65db-723e-42e0-8678-c94f0e8b2442 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:11.079976 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-1a117a72-4980-40d3-85dd-326cacbbefa7 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:11.085532 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-1a117a72-4980-40d3-85dd-326cacbbefa7 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: c8f9aa7c-153d-482a-b048-18cd034d21cb] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:11.105422 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1a117a72-4980-40d3-85dd-326cacbbefa7 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:11.109764 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1a117a72-4980-40d3-85dd-326cacbbefa7 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:11.111308 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1a117a72-4980-40d3-85dd-326cacbbefa7 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:11.111951 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1a117a72-4980-40d3-85dd-326cacbbefa7 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:11.112651 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-f5ee65db-723e-42e0-8678-c94f0e8b2442 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:11.161932 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-f5ee65db-723e-42e0-8678-c94f0e8b2442 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:11.170538 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-f5ee65db-723e-42e0-8678-c94f0e8b2442 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:11.172647 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-f5ee65db-723e-42e0-8678-c94f0e8b2442 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1723 microversion: 2.20 time: 0.316053 May 03 21:35:11.173927 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 461/854] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:35:10 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1723 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:35:11.289405 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-88a3f866-7028-48e1-9adc-37ef4bf4b206 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:11.290904 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-88a3f866-7028-48e1-9adc-37ef4bf4b206 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 4e3930f0-3a9f-4d20-ae74-434e66c18c46] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:11.300997 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-88a3f866-7028-48e1-9adc-37ef4bf4b206 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:11.301621 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-88a3f866-7028-48e1-9adc-37ef4bf4b206 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:11.302656 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-88a3f866-7028-48e1-9adc-37ef4bf4b206 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:11.303086 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-88a3f866-7028-48e1-9adc-37ef4bf4b206 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:11.527085 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-88a3f866-7028-48e1-9adc-37ef4bf4b206 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:11.535689 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-88a3f866-7028-48e1-9adc-37ef4bf4b206 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46" status: 200 len: 1265 microversion: 2.1 time: 0.257041 May 03 21:35:11.536236 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 462/855] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:11 2022] GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46 => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:35:11.941191 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-1a117a72-4980-40d3-85dd-326cacbbefa7 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:11.954087 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-1a117a72-4980-40d3-85dd-326cacbbefa7 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb" status: 200 len: 1366 microversion: 2.1 time: 0.884594 May 03 21:35:11.954888 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 394/856] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:11 2022] GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb => generated 1366 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:35:12.198093 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-de6115d0-0d98-4efe-8517-cd86cdea1309 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:12.198767 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-de6115d0-0d98-4efe-8517-cd86cdea1309 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:12.207122 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-de6115d0-0d98-4efe-8517-cd86cdea1309 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:12.209621 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-de6115d0-0d98-4efe-8517-cd86cdea1309 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:12.209621 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-de6115d0-0d98-4efe-8517-cd86cdea1309 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:12.209621 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-de6115d0-0d98-4efe-8517-cd86cdea1309 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:12.535459 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-de6115d0-0d98-4efe-8517-cd86cdea1309 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:12.552331 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-de6115d0-0d98-4efe-8517-cd86cdea1309 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:12.560447 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-de6115d0-0d98-4efe-8517-cd86cdea1309 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:12.562596 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-de6115d0-0d98-4efe-8517-cd86cdea1309 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1723 microversion: 2.20 time: 0.373677 May 03 21:35:12.563756 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 463/857] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:35:12 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1723 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 21:35:12.566572 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-0619b2bc-f5a1-4911-b3b8-ce7c41705de9 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:12.567951 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-0619b2bc-f5a1-4911-b3b8-ce7c41705de9 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 4e3930f0-3a9f-4d20-ae74-434e66c18c46] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:12.577753 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0619b2bc-f5a1-4911-b3b8-ce7c41705de9 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:12.578742 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0619b2bc-f5a1-4911-b3b8-ce7c41705de9 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:12.579774 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0619b2bc-f5a1-4911-b3b8-ce7c41705de9 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:12.580688 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0619b2bc-f5a1-4911-b3b8-ce7c41705de9 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:12.696200 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-58508e54-9676-406e-8b14-f2469f91a609 req-1f3bd9f0-3449-4edc-b060-8080385cb48d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8f9aa7c-153d-482a-b048-18cd034d21cb", "tag": "479a7085-462d-430f-b37d-544e02378d26"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:35:12.716295 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:35:12.716295 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:35:12.731981 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-58508e54-9676-406e-8b14-f2469f91a609 req-1f3bd9f0-3449-4edc-b060-8080385cb48d service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:12.732455 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-58508e54-9676-406e-8b14-f2469f91a609 req-1f3bd9f0-3449-4edc-b060-8080385cb48d service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:12.759759 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-58508e54-9676-406e-8b14-f2469f91a609 req-1f3bd9f0-3449-4edc-b060-8080385cb48d service nova] Creating event network-changed:479a7085-462d-430f-b37d-544e02378d26 for instance c8f9aa7c-153d-482a-b048-18cd034d21cb on hv-cinder-84037 May 03 21:35:12.765788 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-58508e54-9676-406e-8b14-f2469f91a609 req-1f3bd9f0-3449-4edc-b060-8080385cb48d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083885 May 03 21:35:12.766876 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 464/858] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:35:12.978872 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-c5077d54-c241-4e90-8649-be0c5381c443 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:12.979607 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-c5077d54-c241-4e90-8649-be0c5381c443 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: c8f9aa7c-153d-482a-b048-18cd034d21cb] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:12.990128 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c5077d54-c241-4e90-8649-be0c5381c443 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:12.990128 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c5077d54-c241-4e90-8649-be0c5381c443 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:12.990128 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c5077d54-c241-4e90-8649-be0c5381c443 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:12.990538 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c5077d54-c241-4e90-8649-be0c5381c443 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:13.103364 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-0619b2bc-f5a1-4911-b3b8-ce7c41705de9 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:13.113755 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-0619b2bc-f5a1-4911-b3b8-ce7c41705de9 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46" status: 200 len: 1265 microversion: 2.1 time: 0.560976 May 03 21:35:13.114629 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 395/859] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:12 2022] GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46 => generated 1265 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:35:13.443649 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-c5077d54-c241-4e90-8649-be0c5381c443 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:13.453344 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-c5077d54-c241-4e90-8649-be0c5381c443 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb" status: 200 len: 1366 microversion: 2.1 time: 0.485977 May 03 21:35:13.454153 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 465/860] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:12 2022] GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb => generated 1366 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:35:13.596421 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-508b1f6f-400c-4811-8ca2-ba74dc20f076 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:13.597016 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-508b1f6f-400c-4811-8ca2-ba74dc20f076 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:13.604392 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-508b1f6f-400c-4811-8ca2-ba74dc20f076 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:13.604899 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-508b1f6f-400c-4811-8ca2-ba74dc20f076 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:13.605648 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-508b1f6f-400c-4811-8ca2-ba74dc20f076 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:13.606255 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-508b1f6f-400c-4811-8ca2-ba74dc20f076 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:14.140773 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-1eba6598-14fd-47d8-ae44-4095e70034fd tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:14.144600 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-1eba6598-14fd-47d8-ae44-4095e70034fd tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 4e3930f0-3a9f-4d20-ae74-434e66c18c46] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:14.148550 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-508b1f6f-400c-4811-8ca2-ba74dc20f076 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:14.157959 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-1eba6598-14fd-47d8-ae44-4095e70034fd tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:14.158722 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-1eba6598-14fd-47d8-ae44-4095e70034fd tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:14.159679 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-1eba6598-14fd-47d8-ae44-4095e70034fd tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:14.160269 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-1eba6598-14fd-47d8-ae44-4095e70034fd tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:14.166610 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-508b1f6f-400c-4811-8ca2-ba74dc20f076 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:14.177938 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-508b1f6f-400c-4811-8ca2-ba74dc20f076 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:14.179134 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-508b1f6f-400c-4811-8ca2-ba74dc20f076 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1723 microversion: 2.20 time: 0.593663 May 03 21:35:14.193196 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 396/861] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:35:13 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1723 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:35:14.457494 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-1eba6598-14fd-47d8-ae44-4095e70034fd tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:14.470393 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-1eba6598-14fd-47d8-ae44-4095e70034fd tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46" status: 200 len: 1265 microversion: 2.1 time: 0.341178 May 03 21:35:14.477342 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-28a5d66b-8aee-4c58-943f-21b93d2127e5 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:14.478059 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-28a5d66b-8aee-4c58-943f-21b93d2127e5 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: c8f9aa7c-153d-482a-b048-18cd034d21cb] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:14.482484 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 466/862] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:14 2022] GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46 => generated 1265 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:35:14.496557 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-28a5d66b-8aee-4c58-943f-21b93d2127e5 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:14.497113 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-28a5d66b-8aee-4c58-943f-21b93d2127e5 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:14.497975 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-28a5d66b-8aee-4c58-943f-21b93d2127e5 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:14.498510 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-28a5d66b-8aee-4c58-943f-21b93d2127e5 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:14.726568 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-28a5d66b-8aee-4c58-943f-21b93d2127e5 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:14.737161 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-28a5d66b-8aee-4c58-943f-21b93d2127e5 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb" status: 200 len: 1366 microversion: 2.1 time: 0.269819 May 03 21:35:14.742424 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 397/863] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:14 2022] GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:35:15.210937 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-19870fc1-0107-44f3-a246-cba9a60248f3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:15.211700 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-19870fc1-0107-44f3-a246-cba9a60248f3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:15.220949 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-19870fc1-0107-44f3-a246-cba9a60248f3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:15.221460 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-19870fc1-0107-44f3-a246-cba9a60248f3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:15.222417 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-19870fc1-0107-44f3-a246-cba9a60248f3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:15.222922 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-19870fc1-0107-44f3-a246-cba9a60248f3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:15.478861 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-19870fc1-0107-44f3-a246-cba9a60248f3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:15.494079 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-19870fc1-0107-44f3-a246-cba9a60248f3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:15.497267 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-42fa009e-54e3-47fe-8542-327d1f8f6615 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:15.497978 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-42fa009e-54e3-47fe-8542-327d1f8f6615 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 4e3930f0-3a9f-4d20-ae74-434e66c18c46] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:15.502896 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-19870fc1-0107-44f3-a246-cba9a60248f3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:15.504065 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-19870fc1-0107-44f3-a246-cba9a60248f3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1723 microversion: 2.20 time: 0.303602 May 03 21:35:15.504643 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 467/864] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:35:15 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1723 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:35:15.507636 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-42fa009e-54e3-47fe-8542-327d1f8f6615 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:15.508751 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-42fa009e-54e3-47fe-8542-327d1f8f6615 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:15.509780 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-42fa009e-54e3-47fe-8542-327d1f8f6615 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:15.510316 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-42fa009e-54e3-47fe-8542-327d1f8f6615 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:15.759213 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-42fa009e-54e3-47fe-8542-327d1f8f6615 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:15.762112 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-8cd787e8-c715-4a6b-a664-9321a6ebd1ec tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:15.762804 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-8cd787e8-c715-4a6b-a664-9321a6ebd1ec tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: c8f9aa7c-153d-482a-b048-18cd034d21cb] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:15.770149 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-42fa009e-54e3-47fe-8542-327d1f8f6615 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46" status: 200 len: 1265 microversion: 2.1 time: 0.282772 May 03 21:35:15.771092 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8cd787e8-c715-4a6b-a664-9321a6ebd1ec tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:15.771255 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 398/865] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:15 2022] GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46 => generated 1265 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:35:15.771988 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8cd787e8-c715-4a6b-a664-9321a6ebd1ec tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:15.773253 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8cd787e8-c715-4a6b-a664-9321a6ebd1ec tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:15.773725 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8cd787e8-c715-4a6b-a664-9321a6ebd1ec tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:15.997054 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-8cd787e8-c715-4a6b-a664-9321a6ebd1ec tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:16.008874 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-8cd787e8-c715-4a6b-a664-9321a6ebd1ec tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb" status: 200 len: 1366 microversion: 2.1 time: 0.257295 May 03 21:35:16.009776 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 468/866] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:15 2022] GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:35:16.533626 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-199ad2b1-eca3-4243-beb5-50a7fbf8f919 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:16.534490 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-199ad2b1-eca3-4243-beb5-50a7fbf8f919 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:16.543982 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-199ad2b1-eca3-4243-beb5-50a7fbf8f919 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:16.544643 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-199ad2b1-eca3-4243-beb5-50a7fbf8f919 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:16.545667 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-199ad2b1-eca3-4243-beb5-50a7fbf8f919 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:16.546535 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-199ad2b1-eca3-4243-beb5-50a7fbf8f919 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:16.796562 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-05a129dc-6957-47a3-b636-d06440067c69 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:16.797386 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-05a129dc-6957-47a3-b636-d06440067c69 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 4e3930f0-3a9f-4d20-ae74-434e66c18c46] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:16.805450 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-05a129dc-6957-47a3-b636-d06440067c69 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:16.806058 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-05a129dc-6957-47a3-b636-d06440067c69 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:16.807060 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-05a129dc-6957-47a3-b636-d06440067c69 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:16.807702 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-05a129dc-6957-47a3-b636-d06440067c69 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:16.918192 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-199ad2b1-eca3-4243-beb5-50a7fbf8f919 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:16.937113 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-199ad2b1-eca3-4243-beb5-50a7fbf8f919 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:16.944176 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-199ad2b1-eca3-4243-beb5-50a7fbf8f919 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:16.945659 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-199ad2b1-eca3-4243-beb5-50a7fbf8f919 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1723 microversion: 2.20 time: 0.423440 May 03 21:35:16.945659 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 399/867] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:35:16 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1723 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:35:17.033410 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-65af2c50-fbac-4e87-aa53-e0ce59abfa7a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:17.034164 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-65af2c50-fbac-4e87-aa53-e0ce59abfa7a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: c8f9aa7c-153d-482a-b048-18cd034d21cb] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:17.041604 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-65af2c50-fbac-4e87-aa53-e0ce59abfa7a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:17.042160 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-65af2c50-fbac-4e87-aa53-e0ce59abfa7a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:17.043150 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-65af2c50-fbac-4e87-aa53-e0ce59abfa7a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:17.043590 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-65af2c50-fbac-4e87-aa53-e0ce59abfa7a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:17.212699 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-05a129dc-6957-47a3-b636-d06440067c69 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:17.226696 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-05a129dc-6957-47a3-b636-d06440067c69 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46" status: 200 len: 1265 microversion: 2.1 time: 0.441192 May 03 21:35:17.237741 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 469/868] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:16 2022] GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46 => generated 1265 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:35:17.338294 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-65af2c50-fbac-4e87-aa53-e0ce59abfa7a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:17.348652 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-65af2c50-fbac-4e87-aa53-e0ce59abfa7a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb" status: 200 len: 1366 microversion: 2.1 time: 0.325801 May 03 21:35:17.349220 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 400/869] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:17 2022] GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb => generated 1366 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:35:17.971193 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-15103f82-6cd0-4417-8d72-09e96d913db7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:17.972399 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-15103f82-6cd0-4417-8d72-09e96d913db7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:17.980018 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-15103f82-6cd0-4417-8d72-09e96d913db7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:17.980833 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-15103f82-6cd0-4417-8d72-09e96d913db7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:17.981770 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-15103f82-6cd0-4417-8d72-09e96d913db7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:17.982372 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-15103f82-6cd0-4417-8d72-09e96d913db7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:18.257021 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-b09155bf-71be-43ad-a960-334c355ade8c tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:18.258742 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-b09155bf-71be-43ad-a960-334c355ade8c tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 4e3930f0-3a9f-4d20-ae74-434e66c18c46] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:18.270910 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b09155bf-71be-43ad-a960-334c355ade8c tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:18.271962 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b09155bf-71be-43ad-a960-334c355ade8c tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:18.273492 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b09155bf-71be-43ad-a960-334c355ade8c tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:18.278193 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b09155bf-71be-43ad-a960-334c355ade8c tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:18.289776 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-15103f82-6cd0-4417-8d72-09e96d913db7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:18.306700 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-15103f82-6cd0-4417-8d72-09e96d913db7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:18.314723 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-15103f82-6cd0-4417-8d72-09e96d913db7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:18.315883 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-15103f82-6cd0-4417-8d72-09e96d913db7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1723 microversion: 2.20 time: 0.354679 May 03 21:35:18.316814 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 470/870] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:35:17 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1723 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:35:18.392766 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-0223c898-df2a-48af-8c7a-930797cbab99 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:18.392766 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-0223c898-df2a-48af-8c7a-930797cbab99 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: c8f9aa7c-153d-482a-b048-18cd034d21cb] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:18.402306 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0223c898-df2a-48af-8c7a-930797cbab99 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:18.402995 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0223c898-df2a-48af-8c7a-930797cbab99 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:18.404021 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0223c898-df2a-48af-8c7a-930797cbab99 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:18.404484 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0223c898-df2a-48af-8c7a-930797cbab99 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:18.660831 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-0223c898-df2a-48af-8c7a-930797cbab99 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:18.666311 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-0223c898-df2a-48af-8c7a-930797cbab99 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb" status: 200 len: 1366 microversion: 2.1 time: 0.302819 May 03 21:35:18.667561 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 471/871] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:18 2022] GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb => generated 1366 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:35:18.751401 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-b09155bf-71be-43ad-a960-334c355ade8c tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:18.755606 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-b09155bf-71be-43ad-a960-334c355ade8c tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46" status: 200 len: 1265 microversion: 2.1 time: 0.513298 May 03 21:35:18.756478 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 401/872] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:18 2022] GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46 => generated 1265 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:35:19.340289 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-d311015f-9df3-48e7-92d9-58befb9720bf tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:19.340942 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-d311015f-9df3-48e7-92d9-58befb9720bf tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:19.349665 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d311015f-9df3-48e7-92d9-58befb9720bf tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:19.350121 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d311015f-9df3-48e7-92d9-58befb9720bf tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:19.351005 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d311015f-9df3-48e7-92d9-58befb9720bf tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:19.351489 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d311015f-9df3-48e7-92d9-58befb9720bf tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:19.659456 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-d311015f-9df3-48e7-92d9-58befb9720bf tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:19.679999 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-d311015f-9df3-48e7-92d9-58befb9720bf tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:19.689036 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-d311015f-9df3-48e7-92d9-58befb9720bf tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:19.690847 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-d311015f-9df3-48e7-92d9-58befb9720bf tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1723 microversion: 2.20 time: 0.360512 May 03 21:35:19.694531 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 472/873] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:35:19 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1723 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:35:19.704193 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-b2d146f1-0fba-41fb-8c9f-439d772a9ae0 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:19.705088 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-b2d146f1-0fba-41fb-8c9f-439d772a9ae0 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: c8f9aa7c-153d-482a-b048-18cd034d21cb] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:19.714508 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b2d146f1-0fba-41fb-8c9f-439d772a9ae0 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:19.715045 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b2d146f1-0fba-41fb-8c9f-439d772a9ae0 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:19.716029 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b2d146f1-0fba-41fb-8c9f-439d772a9ae0 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:19.716688 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b2d146f1-0fba-41fb-8c9f-439d772a9ae0 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:19.791574 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-a8fb6885-fdb9-4c81-a384-fe2c943faf76 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:19.793247 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-a8fb6885-fdb9-4c81-a384-fe2c943faf76 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 4e3930f0-3a9f-4d20-ae74-434e66c18c46] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:19.806086 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a8fb6885-fdb9-4c81-a384-fe2c943faf76 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:19.815733 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a8fb6885-fdb9-4c81-a384-fe2c943faf76 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:19.815733 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a8fb6885-fdb9-4c81-a384-fe2c943faf76 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:19.815733 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a8fb6885-fdb9-4c81-a384-fe2c943faf76 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:20.058624 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-b2d146f1-0fba-41fb-8c9f-439d772a9ae0 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:20.071932 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-b2d146f1-0fba-41fb-8c9f-439d772a9ae0 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb" status: 200 len: 1366 microversion: 2.1 time: 0.390454 May 03 21:35:20.083533 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 402/874] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:19 2022] GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb => generated 1366 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:35:20.190260 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-a8fb6885-fdb9-4c81-a384-fe2c943faf76 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:20.198976 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-a8fb6885-fdb9-4c81-a384-fe2c943faf76 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46" status: 200 len: 1265 microversion: 2.1 time: 0.424392 May 03 21:35:20.199534 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 473/875] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:19 2022] GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46 => generated 1265 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:35:20.721818 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-f590a7a2-30ee-49ad-84c1-881aa79dd798 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:20.722958 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-f590a7a2-30ee-49ad-84c1-881aa79dd798 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:20.731254 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f590a7a2-30ee-49ad-84c1-881aa79dd798 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:20.731717 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f590a7a2-30ee-49ad-84c1-881aa79dd798 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:20.732540 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f590a7a2-30ee-49ad-84c1-881aa79dd798 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:20.733589 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f590a7a2-30ee-49ad-84c1-881aa79dd798 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:20.947070 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-f590a7a2-30ee-49ad-84c1-881aa79dd798 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:20.961413 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-f590a7a2-30ee-49ad-84c1-881aa79dd798 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:20.967496 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-f590a7a2-30ee-49ad-84c1-881aa79dd798 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:20.968636 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-f590a7a2-30ee-49ad-84c1-881aa79dd798 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1723 microversion: 2.20 time: 0.260484 May 03 21:35:20.969166 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 403/876] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:35:20 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:35:21.102513 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-12af94a3-0931-4727-b3ff-5c572944dca9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:21.103292 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-12af94a3-0931-4727-b3ff-5c572944dca9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: c8f9aa7c-153d-482a-b048-18cd034d21cb] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:21.112054 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-12af94a3-0931-4727-b3ff-5c572944dca9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:21.150005 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-12af94a3-0931-4727-b3ff-5c572944dca9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:21.150005 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-12af94a3-0931-4727-b3ff-5c572944dca9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:21.150005 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-12af94a3-0931-4727-b3ff-5c572944dca9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:21.227971 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-647a4c5a-150f-47b5-8fa6-665826d0c8a4 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:21.228623 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-647a4c5a-150f-47b5-8fa6-665826d0c8a4 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 4e3930f0-3a9f-4d20-ae74-434e66c18c46] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:21.241297 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-647a4c5a-150f-47b5-8fa6-665826d0c8a4 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:21.242059 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-647a4c5a-150f-47b5-8fa6-665826d0c8a4 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:21.243320 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-647a4c5a-150f-47b5-8fa6-665826d0c8a4 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:21.244042 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-647a4c5a-150f-47b5-8fa6-665826d0c8a4 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:21.365385 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-12af94a3-0931-4727-b3ff-5c572944dca9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:21.374791 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-12af94a3-0931-4727-b3ff-5c572944dca9 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb" status: 200 len: 1366 microversion: 2.1 time: 0.288533 May 03 21:35:21.375465 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 474/877] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:21 2022] GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:35:21.574615 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-647a4c5a-150f-47b5-8fa6-665826d0c8a4 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:21.584096 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-647a4c5a-150f-47b5-8fa6-665826d0c8a4 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46" status: 200 len: 1265 microversion: 2.1 time: 0.371145 May 03 21:35:21.584688 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 404/878] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:21 2022] GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46 => generated 1265 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:35:21.996036 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-a4583aa8-5201-4d09-acad-7961ea1fd96c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:21.996765 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-a4583aa8-5201-4d09-acad-7961ea1fd96c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:22.005189 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a4583aa8-5201-4d09-acad-7961ea1fd96c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:22.005830 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a4583aa8-5201-4d09-acad-7961ea1fd96c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:22.006565 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a4583aa8-5201-4d09-acad-7961ea1fd96c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:22.007002 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a4583aa8-5201-4d09-acad-7961ea1fd96c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:22.237510 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-a4583aa8-5201-4d09-acad-7961ea1fd96c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:22.252073 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-a4583aa8-5201-4d09-acad-7961ea1fd96c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:22.259747 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-a4583aa8-5201-4d09-acad-7961ea1fd96c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:22.261038 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-a4583aa8-5201-4d09-acad-7961ea1fd96c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1723 microversion: 2.20 time: 0.278384 May 03 21:35:22.261588 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 475/879] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:35:21 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1723 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:35:22.288772 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-5cd14eee-28c0-4aac-95c0-da3e63f55c8e req-3f28b010-0a6c-4b43-862c-98951a2dd6ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8f9aa7c-153d-482a-b048-18cd034d21cb", "name": "network-vif-plugged", "status": "completed", "tag": "479a7085-462d-430f-b37d-544e02378d26"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:35:22.295303 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:35:22.295303 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:35:22.304340 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-5cd14eee-28c0-4aac-95c0-da3e63f55c8e req-3f28b010-0a6c-4b43-862c-98951a2dd6ae service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:22.304902 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-5cd14eee-28c0-4aac-95c0-da3e63f55c8e req-3f28b010-0a6c-4b43-862c-98951a2dd6ae service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:22.323306 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-5cd14eee-28c0-4aac-95c0-da3e63f55c8e req-3f28b010-0a6c-4b43-862c-98951a2dd6ae service nova] Creating event network-vif-plugged:479a7085-462d-430f-b37d-544e02378d26 for instance c8f9aa7c-153d-482a-b048-18cd034d21cb on hv-cinder-84037 May 03 21:35:22.330898 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-5cd14eee-28c0-4aac-95c0-da3e63f55c8e req-3f28b010-0a6c-4b43-862c-98951a2dd6ae service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051896 May 03 21:35:22.331835 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 405/880] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:35:22.399888 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-8fb9860d-f445-4602-a58b-0dd8d401a8e0 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:22.400543 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-8fb9860d-f445-4602-a58b-0dd8d401a8e0 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: c8f9aa7c-153d-482a-b048-18cd034d21cb] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:22.409031 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8fb9860d-f445-4602-a58b-0dd8d401a8e0 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:22.409031 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8fb9860d-f445-4602-a58b-0dd8d401a8e0 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:22.411478 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8fb9860d-f445-4602-a58b-0dd8d401a8e0 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:22.411478 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8fb9860d-f445-4602-a58b-0dd8d401a8e0 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:22.608742 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-6c64fa8a-f4cb-4d7a-86c4-3237ed491ff2 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:22.609598 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-6c64fa8a-f4cb-4d7a-86c4-3237ed491ff2 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 4e3930f0-3a9f-4d20-ae74-434e66c18c46] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:22.623885 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6c64fa8a-f4cb-4d7a-86c4-3237ed491ff2 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:22.627023 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6c64fa8a-f4cb-4d7a-86c4-3237ed491ff2 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:22.627023 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6c64fa8a-f4cb-4d7a-86c4-3237ed491ff2 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:22.627023 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6c64fa8a-f4cb-4d7a-86c4-3237ed491ff2 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:22.692180 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-8fb9860d-f445-4602-a58b-0dd8d401a8e0 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:22.703786 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-8fb9860d-f445-4602-a58b-0dd8d401a8e0 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb" status: 200 len: 1366 microversion: 2.1 time: 0.312830 May 03 21:35:22.704710 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 476/881] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:22 2022] GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:35:22.968268 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-6c64fa8a-f4cb-4d7a-86c4-3237ed491ff2 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:22.983770 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-6c64fa8a-f4cb-4d7a-86c4-3237ed491ff2 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46" status: 200 len: 1265 microversion: 2.1 time: 0.385408 May 03 21:35:22.984745 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 406/882] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:22 2022] GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46 => generated 1265 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:35:23.285289 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-649e318e-ba43-43aa-bf08-9d6d2e30a92f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:23.286522 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-649e318e-ba43-43aa-bf08-9d6d2e30a92f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:23.293851 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-649e318e-ba43-43aa-bf08-9d6d2e30a92f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:23.294302 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-649e318e-ba43-43aa-bf08-9d6d2e30a92f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:23.296058 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-649e318e-ba43-43aa-bf08-9d6d2e30a92f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:23.296058 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-649e318e-ba43-43aa-bf08-9d6d2e30a92f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:23.612970 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-649e318e-ba43-43aa-bf08-9d6d2e30a92f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:23.627777 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-649e318e-ba43-43aa-bf08-9d6d2e30a92f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:23.633955 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-649e318e-ba43-43aa-bf08-9d6d2e30a92f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:23.635051 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-649e318e-ba43-43aa-bf08-9d6d2e30a92f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1723 microversion: 2.20 time: 0.359869 May 03 21:35:23.635574 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 477/883] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:35:23 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1723 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:35:23.728053 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-5e0ebd67-2e02-4ac2-b8e3-300c325ae5ec tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:23.728709 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-5e0ebd67-2e02-4ac2-b8e3-300c325ae5ec tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: c8f9aa7c-153d-482a-b048-18cd034d21cb] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:23.736444 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5e0ebd67-2e02-4ac2-b8e3-300c325ae5ec tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:23.736910 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5e0ebd67-2e02-4ac2-b8e3-300c325ae5ec tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:23.737677 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5e0ebd67-2e02-4ac2-b8e3-300c325ae5ec tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:23.738112 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5e0ebd67-2e02-4ac2-b8e3-300c325ae5ec tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:23.949993 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-5e0ebd67-2e02-4ac2-b8e3-300c325ae5ec tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:23.958356 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-5e0ebd67-2e02-4ac2-b8e3-300c325ae5ec tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb" status: 200 len: 1366 microversion: 2.1 time: 0.239875 May 03 21:35:23.958894 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 407/884] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:23 2022] GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:35:24.010043 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-f1209a23-d071-45e2-bb3d-06261db1a0af tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:24.010659 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-f1209a23-d071-45e2-bb3d-06261db1a0af tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 4e3930f0-3a9f-4d20-ae74-434e66c18c46] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:24.020066 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f1209a23-d071-45e2-bb3d-06261db1a0af tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:24.022692 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f1209a23-d071-45e2-bb3d-06261db1a0af tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:24.023553 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f1209a23-d071-45e2-bb3d-06261db1a0af tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:24.024146 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f1209a23-d071-45e2-bb3d-06261db1a0af tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:24.253627 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-f1209a23-d071-45e2-bb3d-06261db1a0af tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:24.265503 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-f1209a23-d071-45e2-bb3d-06261db1a0af tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46" status: 200 len: 1265 microversion: 2.1 time: 0.267950 May 03 21:35:24.266989 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 478/885] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:23 2022] GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46 => generated 1265 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:35:24.382627 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-7933f79b-5f34-427d-aff3-297302e8bc5e req-9523d997-ff42-49b1-b085-264db8194581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e3930f0-3a9f-4d20-ae74-434e66c18c46", "name": "network-vif-plugged", "status": "completed", "tag": "d3860f2c-7b5b-47b1-89e7-e6eac5582cd6"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:35:24.396847 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:35:24.396847 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:35:24.413609 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-7933f79b-5f34-427d-aff3-297302e8bc5e req-9523d997-ff42-49b1-b085-264db8194581 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:24.413970 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-7933f79b-5f34-427d-aff3-297302e8bc5e req-9523d997-ff42-49b1-b085-264db8194581 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:24.435635 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-7933f79b-5f34-427d-aff3-297302e8bc5e req-9523d997-ff42-49b1-b085-264db8194581 service nova] Creating event network-vif-plugged:d3860f2c-7b5b-47b1-89e7-e6eac5582cd6 for instance 4e3930f0-3a9f-4d20-ae74-434e66c18c46 on hv-cinder-84037 May 03 21:35:24.445362 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-7933f79b-5f34-427d-aff3-297302e8bc5e req-9523d997-ff42-49b1-b085-264db8194581 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072453 May 03 21:35:24.446946 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 408/886] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:35:24.613066 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-b72bfcde-9323-4839-bc1e-89eea923f398 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:24.613695 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-b72bfcde-9323-4839-bc1e-89eea923f398 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:24.621946 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b72bfcde-9323-4839-bc1e-89eea923f398 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:24.622760 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b72bfcde-9323-4839-bc1e-89eea923f398 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:24.624094 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b72bfcde-9323-4839-bc1e-89eea923f398 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:24.624987 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b72bfcde-9323-4839-bc1e-89eea923f398 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:24.668627 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-371d1138-48eb-4d36-9f13-785cddd812fa tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:24.669264 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-371d1138-48eb-4d36-9f13-785cddd812fa tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:24.689246 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-371d1138-48eb-4d36-9f13-785cddd812fa tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:24.692000 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-371d1138-48eb-4d36-9f13-785cddd812fa tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:24.693517 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-371d1138-48eb-4d36-9f13-785cddd812fa tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:24.696697 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-371d1138-48eb-4d36-9f13-785cddd812fa tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:24.700457 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-b72bfcde-9323-4839-bc1e-89eea923f398 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87/ips" status: 200 len: 145 microversion: 2.1 time: 0.096815 May 03 21:35:24.702312 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 479/887] 10.222.0.48 () {58 vars in 1247 bytes} [Tue May 3 21:35:24 2022] GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87/ips => generated 145 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:35:24.982230 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-5128bad5-00f4-48c9-8e95-b0bf6b4aae2f tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:24.983211 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-5128bad5-00f4-48c9-8e95-b0bf6b4aae2f tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: c8f9aa7c-153d-482a-b048-18cd034d21cb] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:24.993672 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5128bad5-00f4-48c9-8e95-b0bf6b4aae2f tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:24.994497 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5128bad5-00f4-48c9-8e95-b0bf6b4aae2f tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:24.996023 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5128bad5-00f4-48c9-8e95-b0bf6b4aae2f tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:24.996630 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5128bad5-00f4-48c9-8e95-b0bf6b4aae2f tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:25.231029 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-371d1138-48eb-4d36-9f13-785cddd812fa tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:25.275908 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-371d1138-48eb-4d36-9f13-785cddd812fa tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:25.288136 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-371d1138-48eb-4d36-9f13-785cddd812fa tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:25.290353 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-371d1138-48eb-4d36-9f13-785cddd812fa tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1744 microversion: 2.20 time: 0.639363 May 03 21:35:25.305281 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 409/888] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:35:24 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1744 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:35:25.309268 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-5128bad5-00f4-48c9-8e95-b0bf6b4aae2f tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:25.319735 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-a4b745a2-5b02-43b3-897c-1780fb3bc41a tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:25.320909 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-a4b745a2-5b02-43b3-897c-1780fb3bc41a tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 4e3930f0-3a9f-4d20-ae74-434e66c18c46] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:25.330345 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-5128bad5-00f4-48c9-8e95-b0bf6b4aae2f tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb" status: 200 len: 1556 microversion: 2.1 time: 0.358329 May 03 21:35:25.331115 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 480/889] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:24 2022] GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb => generated 1556 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:35:25.334307 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a4b745a2-5b02-43b3-897c-1780fb3bc41a tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:25.334875 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a4b745a2-5b02-43b3-897c-1780fb3bc41a tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:25.336028 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a4b745a2-5b02-43b3-897c-1780fb3bc41a tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:25.336558 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a4b745a2-5b02-43b3-897c-1780fb3bc41a tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:25.361242 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-9d0e3e94-f304-4c0c-a96c-ac8fd7e76b3c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:25.362201 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-9d0e3e94-f304-4c0c-a96c-ac8fd7e76b3c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: c8f9aa7c-153d-482a-b048-18cd034d21cb] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:25.371225 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9d0e3e94-f304-4c0c-a96c-ac8fd7e76b3c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:25.372459 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9d0e3e94-f304-4c0c-a96c-ac8fd7e76b3c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:25.382239 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9d0e3e94-f304-4c0c-a96c-ac8fd7e76b3c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:25.382239 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9d0e3e94-f304-4c0c-a96c-ac8fd7e76b3c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:25.578022 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-9d0e3e94-f304-4c0c-a96c-ac8fd7e76b3c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.228069 May 03 21:35:25.578932 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 481/890] 10.222.0.48 () {58 vars in 1274 bytes} [Tue May 3 21:35:25 2022] GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb/os-interface => generated 285 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:35:25.603210 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-a4b745a2-5b02-43b3-897c-1780fb3bc41a tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:25.613678 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-a4b745a2-5b02-43b3-897c-1780fb3bc41a tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46" status: 200 len: 1265 microversion: 2.1 time: 0.307151 May 03 21:35:25.617911 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 410/891] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:25 2022] GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46 => generated 1265 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:35:26.326083 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-08a02ec4-10db-43a7-9b9f-c585c0791414 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:26.327122 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-08a02ec4-10db-43a7-9b9f-c585c0791414 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:26.337389 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-08a02ec4-10db-43a7-9b9f-c585c0791414 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:26.337389 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-08a02ec4-10db-43a7-9b9f-c585c0791414 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:26.339037 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-08a02ec4-10db-43a7-9b9f-c585c0791414 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:26.340002 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-08a02ec4-10db-43a7-9b9f-c585c0791414 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:26.479764 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-96422ed6-03ff-426c-8ff6-1d0f01bee111 req-a9db60a9-ca51-497a-a581-3546b744f29e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49b86a80-657d-4e94-bc71-bcfe8f276469", "name": "network-vif-plugged", "status": "completed", "tag": "4a088512-8058-4a9a-a45b-177671d97cfc"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:35:26.489174 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:35:26.489174 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:35:26.502671 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-96422ed6-03ff-426c-8ff6-1d0f01bee111 req-a9db60a9-ca51-497a-a581-3546b744f29e service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:26.510857 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-96422ed6-03ff-426c-8ff6-1d0f01bee111 req-a9db60a9-ca51-497a-a581-3546b744f29e service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:26.525699 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-96422ed6-03ff-426c-8ff6-1d0f01bee111 req-a9db60a9-ca51-497a-a581-3546b744f29e service nova] Creating event network-vif-plugged:4a088512-8058-4a9a-a45b-177671d97cfc for instance 49b86a80-657d-4e94-bc71-bcfe8f276469 on hv-cinder-84037 May 03 21:35:26.530264 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-96422ed6-03ff-426c-8ff6-1d0f01bee111 req-a9db60a9-ca51-497a-a581-3546b744f29e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071788 May 03 21:35:26.531537 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 411/892] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:35:26.643392 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-eeb88471-5e02-4800-b48b-158a5dc14c8f tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:26.644100 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-eeb88471-5e02-4800-b48b-158a5dc14c8f tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 4e3930f0-3a9f-4d20-ae74-434e66c18c46] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:26.651711 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-eeb88471-5e02-4800-b48b-158a5dc14c8f tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:26.652168 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-eeb88471-5e02-4800-b48b-158a5dc14c8f tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:26.653009 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-eeb88471-5e02-4800-b48b-158a5dc14c8f tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:26.653459 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-eeb88471-5e02-4800-b48b-158a5dc14c8f tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:26.688247 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-08a02ec4-10db-43a7-9b9f-c585c0791414 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:26.719295 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-08a02ec4-10db-43a7-9b9f-c585c0791414 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:26.732554 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-08a02ec4-10db-43a7-9b9f-c585c0791414 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:26.735383 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-08a02ec4-10db-43a7-9b9f-c585c0791414 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1744 microversion: 2.20 time: 0.419970 May 03 21:35:26.736389 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 482/893] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:35:26 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1744 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:35:26.910197 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-ef48b874-ef3e-4b5a-ba76-22bf511fef56 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c16b3c62-08be-43c3-952a-6f5f50dc86e5"}} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:35:26.916775 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-ef48b874-ef3e-4b5a-ba76-22bf511fef56 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:26.942294 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ef48b874-ef3e-4b5a-ba76-22bf511fef56 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:26.943165 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ef48b874-ef3e-4b5a-ba76-22bf511fef56 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:26.944580 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ef48b874-ef3e-4b5a-ba76-22bf511fef56 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:26.945256 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ef48b874-ef3e-4b5a-ba76-22bf511fef56 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:27.003745 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-eeb88471-5e02-4800-b48b-158a5dc14c8f tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:27.018457 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-eeb88471-5e02-4800-b48b-158a5dc14c8f tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46" status: 200 len: 1265 microversion: 2.1 time: 0.383443 May 03 21:35:27.023454 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 412/894] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:26 2022] GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46 => generated 1265 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:35:27.337978 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-3865467c-7cab-40bd-95ce-ee5ccdf96b02 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1209098754"}} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:35:27.338531 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-3865467c-7cab-40bd-95ce-ee5ccdf96b02 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:27.347157 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-3865467c-7cab-40bd-95ce-ee5ccdf96b02 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:27.347608 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-3865467c-7cab-40bd-95ce-ee5ccdf96b02 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:27.348387 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-3865467c-7cab-40bd-95ce-ee5ccdf96b02 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:27.348860 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-3865467c-7cab-40bd-95ce-ee5ccdf96b02 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:27.695011 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.network.security_group_api [None req-3865467c-7cab-40bd-95ce-ee5ccdf96b02 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Removing security group d42fd400-718a-4705-ba88-26516eaca3fc from port 85f0f545-6b51-41b2-a9ee-a8c17abc2f57 May 03 21:35:28.378177 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-ef48b874-ef3e-4b5a-ba76-22bf511fef56 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "POST /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.495713 May 03 21:35:28.380377 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 483/895] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 3 21:35:26 2022] POST /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87/os-volume_attachments => generated 194 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:35:28.410750 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-def6d2cb-d4d1-433a-bbe9-95711dd57569 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:28.412567 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-def6d2cb-d4d1-433a-bbe9-95711dd57569 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:28.440745 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-def6d2cb-d4d1-433a-bbe9-95711dd57569 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:28.441601 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-def6d2cb-d4d1-433a-bbe9-95711dd57569 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:28.442986 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-def6d2cb-d4d1-433a-bbe9-95711dd57569 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:28.443663 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-def6d2cb-d4d1-433a-bbe9-95711dd57569 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:28.526915 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-3865467c-7cab-40bd-95ce-ee5ccdf96b02 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "POST /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42/action" status: 202 len: 0 microversion: 2.1 time: 1.201825 May 03 21:35:28.528782 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 413/896] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 3 21:35:27 2022] POST /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42/action => generated 0 bytes in 1204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 03 21:35:28.573682 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-4c0cad13-3565-456f-92de-7684945c7fb0 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:28.574322 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-4c0cad13-3565-456f-92de-7684945c7fb0 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 4e3930f0-3a9f-4d20-ae74-434e66c18c46] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:28.608820 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4c0cad13-3565-456f-92de-7684945c7fb0 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:28.612668 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4c0cad13-3565-456f-92de-7684945c7fb0 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:28.616827 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4c0cad13-3565-456f-92de-7684945c7fb0 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:28.619022 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4c0cad13-3565-456f-92de-7684945c7fb0 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:29.341695 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-def6d2cb-d4d1-433a-bbe9-95711dd57569 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:29.398129 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-def6d2cb-d4d1-433a-bbe9-95711dd57569 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:29.413139 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-4c0cad13-3565-456f-92de-7684945c7fb0 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:29.414272 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-def6d2cb-d4d1-433a-bbe9-95711dd57569 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:29.415807 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-def6d2cb-d4d1-433a-bbe9-95711dd57569 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1739 microversion: 2.20 time: 1.033752 May 03 21:35:29.416468 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 484/897] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:35:28 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1739 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:35:29.424230 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-4c0cad13-3565-456f-92de-7684945c7fb0 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46" status: 200 len: 1452 microversion: 2.1 time: 0.893641 May 03 21:35:29.425134 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 414/898] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:28 2022] GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46 => generated 1452 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:35:29.438095 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-d43d28a9-238d-4c95-b39d-182ff0c8dabe req-830176fc-94c0-4081-bea7-6cb41d799fea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f13ba9d5-9344-4748-8e24-118858bfce42", "tag": "85f0f545-6b51-41b2-a9ee-a8c17abc2f57"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:35:29.446169 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:35:29.446169 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:35:29.459660 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-d43d28a9-238d-4c95-b39d-182ff0c8dabe req-830176fc-94c0-4081-bea7-6cb41d799fea service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:29.460227 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-d43d28a9-238d-4c95-b39d-182ff0c8dabe req-830176fc-94c0-4081-bea7-6cb41d799fea service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:29.462565 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-0450b4ee-2f20-4859-a44f-947cec41433d req-064a68b8-d598-44dc-bca9-d410a4e89e9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8f9aa7c-153d-482a-b048-18cd034d21cb", "tag": "479a7085-462d-430f-b37d-544e02378d26"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:35:29.472685 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:35:29.472685 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:35:29.505664 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-0450b4ee-2f20-4859-a44f-947cec41433d req-064a68b8-d598-44dc-bca9-d410a4e89e9c service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:29.506114 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-0450b4ee-2f20-4859-a44f-947cec41433d req-064a68b8-d598-44dc-bca9-d410a4e89e9c service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:29.516891 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-d43d28a9-238d-4c95-b39d-182ff0c8dabe req-830176fc-94c0-4081-bea7-6cb41d799fea service nova] Creating event network-changed:85f0f545-6b51-41b2-a9ee-a8c17abc2f57 for instance f13ba9d5-9344-4748-8e24-118858bfce42 on hv-cinder-84037 May 03 21:35:29.530335 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-d43d28a9-238d-4c95-b39d-182ff0c8dabe req-830176fc-94c0-4081-bea7-6cb41d799fea service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103230 May 03 21:35:29.531016 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 415/899] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:35:29.560257 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-0450b4ee-2f20-4859-a44f-947cec41433d req-064a68b8-d598-44dc-bca9-d410a4e89e9c service nova] Creating event network-changed:479a7085-462d-430f-b37d-544e02378d26 for instance c8f9aa7c-153d-482a-b048-18cd034d21cb on hv-cinder-84037 May 03 21:35:29.568305 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-0450b4ee-2f20-4859-a44f-947cec41433d req-064a68b8-d598-44dc-bca9-d410a4e89e9c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148517 May 03 21:35:29.569050 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 485/900] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:35:29.580006 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-0fceef4b-a5f7-40d8-bc3c-f191d4592fa3 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:29.581031 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-0fceef4b-a5f7-40d8-bc3c-f191d4592fa3 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 4e3930f0-3a9f-4d20-ae74-434e66c18c46] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:29.606113 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0fceef4b-a5f7-40d8-bc3c-f191d4592fa3 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:29.609414 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0fceef4b-a5f7-40d8-bc3c-f191d4592fa3 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:29.611437 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0fceef4b-a5f7-40d8-bc3c-f191d4592fa3 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:29.612341 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0fceef4b-a5f7-40d8-bc3c-f191d4592fa3 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:30.444278 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-12f33048-0f2b-41c5-90da-c52ccb6b607d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:30.446286 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-12f33048-0f2b-41c5-90da-c52ccb6b607d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:30.458992 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-12f33048-0f2b-41c5-90da-c52ccb6b607d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:30.464144 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-12f33048-0f2b-41c5-90da-c52ccb6b607d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:30.464144 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-12f33048-0f2b-41c5-90da-c52ccb6b607d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:30.464144 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-12f33048-0f2b-41c5-90da-c52ccb6b607d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:30.563114 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-0fceef4b-a5f7-40d8-bc3c-f191d4592fa3 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:30.588685 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-0fceef4b-a5f7-40d8-bc3c-f191d4592fa3 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46" status: 200 len: 1452 microversion: 2.1 time: 1.051397 May 03 21:35:30.601689 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 416/901] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:29 2022] GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46 => generated 1452 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:35:31.347328 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-12f33048-0f2b-41c5-90da-c52ccb6b607d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:31.362502 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-12f33048-0f2b-41c5-90da-c52ccb6b607d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:31.371251 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-12f33048-0f2b-41c5-90da-c52ccb6b607d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:31.372782 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-12f33048-0f2b-41c5-90da-c52ccb6b607d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1739 microversion: 2.20 time: 0.940240 May 03 21:35:31.374886 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 486/902] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:35:30 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1739 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 21:35:32.406431 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-bf2a7259-187a-4675-b71f-7a1d2a16fe4e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:32.408523 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-bf2a7259-187a-4675-b71f-7a1d2a16fe4e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:32.425371 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-bf2a7259-187a-4675-b71f-7a1d2a16fe4e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:32.426416 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-bf2a7259-187a-4675-b71f-7a1d2a16fe4e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:32.427577 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-bf2a7259-187a-4675-b71f-7a1d2a16fe4e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:32.428370 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-bf2a7259-187a-4675-b71f-7a1d2a16fe4e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:32.738308 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-bf2a7259-187a-4675-b71f-7a1d2a16fe4e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:32.775936 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-bf2a7259-187a-4675-b71f-7a1d2a16fe4e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:32.784908 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-bf2a7259-187a-4675-b71f-7a1d2a16fe4e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:32.786349 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-bf2a7259-187a-4675-b71f-7a1d2a16fe4e tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1739 microversion: 2.20 time: 0.395535 May 03 21:35:32.787080 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 417/903] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:35:32 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1739 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 21:35:33.554850 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-5c64e703-d47f-4904-bcc2-b09b8c20fe71 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:33.555735 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-5c64e703-d47f-4904-bcc2-b09b8c20fe71 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:33.589894 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5c64e703-d47f-4904-bcc2-b09b8c20fe71 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:33.590642 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5c64e703-d47f-4904-bcc2-b09b8c20fe71 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:33.592682 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5c64e703-d47f-4904-bcc2-b09b8c20fe71 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:33.593867 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5c64e703-d47f-4904-bcc2-b09b8c20fe71 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:33.619360 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-fb141863-bae8-4f00-9963-775d0a4a2d7d req-e730ed13-1b20-4b29-aea0-fcf369e96629 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f13ba9d5-9344-4748-8e24-118858bfce42", "tag": "85f0f545-6b51-41b2-a9ee-a8c17abc2f57"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:35:33.631552 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:35:33.631552 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:35:33.677219 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-fb141863-bae8-4f00-9963-775d0a4a2d7d req-e730ed13-1b20-4b29-aea0-fcf369e96629 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:33.677694 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-fb141863-bae8-4f00-9963-775d0a4a2d7d req-e730ed13-1b20-4b29-aea0-fcf369e96629 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:33.745497 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-fb141863-bae8-4f00-9963-775d0a4a2d7d req-e730ed13-1b20-4b29-aea0-fcf369e96629 service nova] Creating event network-changed:85f0f545-6b51-41b2-a9ee-a8c17abc2f57 for instance f13ba9d5-9344-4748-8e24-118858bfce42 on hv-cinder-84037 May 03 21:35:33.764851 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-fb141863-bae8-4f00-9963-775d0a4a2d7d req-e730ed13-1b20-4b29-aea0-fcf369e96629 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150579 May 03 21:35:33.764851 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 418/904] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:35:33.819681 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-b33588c3-f256-4205-b669-e72eba90ebbe tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:33.820781 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-b33588c3-f256-4205-b669-e72eba90ebbe tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:33.863167 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b33588c3-f256-4205-b669-e72eba90ebbe tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:33.871196 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b33588c3-f256-4205-b669-e72eba90ebbe tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:33.872818 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b33588c3-f256-4205-b669-e72eba90ebbe tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:33.874980 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b33588c3-f256-4205-b669-e72eba90ebbe tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:34.533046 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-5c64e703-d47f-4904-bcc2-b09b8c20fe71 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42/os-volume_attachments/00f030a2-494e-4d19-8410-3ca3ef055bd5" status: 202 len: 0 microversion: 2.1 time: 1.023874 May 03 21:35:34.536206 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 487/905] 10.222.0.48 () {58 vars in 1415 bytes} [Tue May 3 21:35:33 2022] DELETE /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42/os-volume_attachments/00f030a2-494e-4d19-8410-3ca3ef055bd5 => generated 0 bytes in 1026 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 21:35:34.549626 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-b33588c3-f256-4205-b669-e72eba90ebbe tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:34.568143 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-6c08bbb5-df38-4117-a666-179a5da16b36 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:34.572491 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-6c08bbb5-df38-4117-a666-179a5da16b36 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:34.573690 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-b33588c3-f256-4205-b669-e72eba90ebbe tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:34.589398 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-b33588c3-f256-4205-b669-e72eba90ebbe tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:34.589398 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-b33588c3-f256-4205-b669-e72eba90ebbe tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1739 microversion: 2.20 time: 0.783969 May 03 21:35:34.589837 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 419/906] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:35:33 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1739 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:35:34.610134 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6c08bbb5-df38-4117-a666-179a5da16b36 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:34.612226 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6c08bbb5-df38-4117-a666-179a5da16b36 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:34.614980 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6c08bbb5-df38-4117-a666-179a5da16b36 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:34.615686 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6c08bbb5-df38-4117-a666-179a5da16b36 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:34.954077 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-6c08bbb5-df38-4117-a666-179a5da16b36 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.414745 May 03 21:35:34.958206 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 488/907] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 3 21:35:34 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42/os-volume_attachments => generated 197 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:35:35.620322 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-4d3b1207-c2e4-4234-b607-95df9c34cbca tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:35.621685 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-4d3b1207-c2e4-4234-b607-95df9c34cbca tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:35.630599 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4d3b1207-c2e4-4234-b607-95df9c34cbca tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:35.631040 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4d3b1207-c2e4-4234-b607-95df9c34cbca tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:35.632455 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4d3b1207-c2e4-4234-b607-95df9c34cbca tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:35.633446 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4d3b1207-c2e4-4234-b607-95df9c34cbca tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:35.975054 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-4d3b1207-c2e4-4234-b607-95df9c34cbca tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:35.976305 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-cc5ac5a0-849d-49c3-8aca-3678a7cec604 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:35.979126 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-cc5ac5a0-849d-49c3-8aca-3678a7cec604 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:35.994946 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cc5ac5a0-849d-49c3-8aca-3678a7cec604 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:35.998072 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cc5ac5a0-849d-49c3-8aca-3678a7cec604 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:36.011753 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-4d3b1207-c2e4-4234-b607-95df9c34cbca tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:36.018454 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cc5ac5a0-849d-49c3-8aca-3678a7cec604 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:36.018904 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cc5ac5a0-849d-49c3-8aca-3678a7cec604 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:36.022220 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-4d3b1207-c2e4-4234-b607-95df9c34cbca tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:36.031079 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-4d3b1207-c2e4-4234-b607-95df9c34cbca tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1739 microversion: 2.20 time: 0.426785 May 03 21:35:36.035438 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 420/908] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:35:35 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1739 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:35:36.186771 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-cc5ac5a0-849d-49c3-8aca-3678a7cec604 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.223719 May 03 21:35:36.187998 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 489/909] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 3 21:35:35 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42/os-volume_attachments => generated 197 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:35:37.058867 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-96fe744a-9508-45b3-8a1c-5ddc86678401 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:37.060488 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-96fe744a-9508-45b3-8a1c-5ddc86678401 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:37.073596 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-96fe744a-9508-45b3-8a1c-5ddc86678401 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:37.074643 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-96fe744a-9508-45b3-8a1c-5ddc86678401 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:37.075683 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-96fe744a-9508-45b3-8a1c-5ddc86678401 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:37.076510 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-96fe744a-9508-45b3-8a1c-5ddc86678401 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:37.214165 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-d5c7e8a5-96b9-403f-8252-8108394f9ce4 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:37.223885 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-d5c7e8a5-96b9-403f-8252-8108394f9ce4 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:37.251054 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d5c7e8a5-96b9-403f-8252-8108394f9ce4 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:37.251504 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d5c7e8a5-96b9-403f-8252-8108394f9ce4 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:37.258389 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d5c7e8a5-96b9-403f-8252-8108394f9ce4 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:37.261503 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d5c7e8a5-96b9-403f-8252-8108394f9ce4 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:37.522415 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-d5c7e8a5-96b9-403f-8252-8108394f9ce4 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.323356 May 03 21:35:37.522783 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-96fe744a-9508-45b3-8a1c-5ddc86678401 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:37.524374 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 490/910] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 3 21:35:37 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42/os-volume_attachments => generated 197 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:35:37.539245 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-c9ed2ba1-7fb5-4f9e-b5ce-3355a8480d84 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:37.541438 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-c9ed2ba1-7fb5-4f9e-b5ce-3355a8480d84 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:37.550861 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c9ed2ba1-7fb5-4f9e-b5ce-3355a8480d84 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:37.551755 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c9ed2ba1-7fb5-4f9e-b5ce-3355a8480d84 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:37.553021 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c9ed2ba1-7fb5-4f9e-b5ce-3355a8480d84 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:37.553780 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c9ed2ba1-7fb5-4f9e-b5ce-3355a8480d84 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:37.556522 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-96fe744a-9508-45b3-8a1c-5ddc86678401 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:37.577054 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-96fe744a-9508-45b3-8a1c-5ddc86678401 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:37.581260 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-96fe744a-9508-45b3-8a1c-5ddc86678401 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1739 microversion: 2.20 time: 0.534857 May 03 21:35:37.584865 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 421/911] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:35:37 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1739 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:35:37.625764 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-2c190100-7723-4e86-b392-bac897e1e7c5 req-4d99b524-a1d3-4349-b776-d96045deacc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e3930f0-3a9f-4d20-ae74-434e66c18c46", "tag": "d3860f2c-7b5b-47b1-89e7-e6eac5582cd6"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:35:37.647859 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:35:37.647859 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:35:37.668734 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-2c190100-7723-4e86-b392-bac897e1e7c5 req-4d99b524-a1d3-4349-b776-d96045deacc6 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:37.671414 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-2c190100-7723-4e86-b392-bac897e1e7c5 req-4d99b524-a1d3-4349-b776-d96045deacc6 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:37.679843 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-c9ed2ba1-7fb5-4f9e-b5ce-3355a8480d84 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154083 May 03 21:35:37.681411 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 491/912] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 3 21:35:37 2022] GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:35:37.700810 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-2c190100-7723-4e86-b392-bac897e1e7c5 req-4d99b524-a1d3-4349-b776-d96045deacc6 service nova] Creating event network-changed:d3860f2c-7b5b-47b1-89e7-e6eac5582cd6 for instance 4e3930f0-3a9f-4d20-ae74-434e66c18c46 on hv-cinder-84037 May 03 21:35:37.715285 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-dab88745-ebda-4837-8da0-0223678a8eba tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:37.715960 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-dab88745-ebda-4837-8da0-0223678a8eba tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:37.725435 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-2c190100-7723-4e86-b392-bac897e1e7c5 req-4d99b524-a1d3-4349-b776-d96045deacc6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138862 May 03 21:35:37.726973 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 422/913] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:35:37.739144 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-dab88745-ebda-4837-8da0-0223678a8eba tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:37.739606 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-dab88745-ebda-4837-8da0-0223678a8eba tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:37.746869 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-dab88745-ebda-4837-8da0-0223678a8eba tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:37.746869 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-dab88745-ebda-4837-8da0-0223678a8eba tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:37.886125 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-dab88745-ebda-4837-8da0-0223678a8eba tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87/os-volume_attachments/c16b3c62-08be-43c3-952a-6f5f50dc86e5" status: 200 len: 194 microversion: 2.1 time: 0.195017 May 03 21:35:37.887053 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 492/914] 10.222.0.48 () {58 vars in 1412 bytes} [Tue May 3 21:35:37 2022] GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87/os-volume_attachments/c16b3c62-08be-43c3-952a-6f5f50dc86e5 => generated 194 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:35:38.548553 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-6c1f0d96-6a0e-4731-9296-f906c80bf351 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:38.552469 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-6c1f0d96-6a0e-4731-9296-f906c80bf351 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:38.612566 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6c1f0d96-6a0e-4731-9296-f906c80bf351 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:38.624819 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6c1f0d96-6a0e-4731-9296-f906c80bf351 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:38.625950 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6c1f0d96-6a0e-4731-9296-f906c80bf351 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:38.626469 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6c1f0d96-6a0e-4731-9296-f906c80bf351 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:38.630552 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-80d63677-e60f-4cff-bf18-41988209ab07 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:38.634072 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-80d63677-e60f-4cff-bf18-41988209ab07 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:38.649485 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-80d63677-e60f-4cff-bf18-41988209ab07 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:38.651256 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-80d63677-e60f-4cff-bf18-41988209ab07 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:38.653492 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-80d63677-e60f-4cff-bf18-41988209ab07 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:38.655080 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-80d63677-e60f-4cff-bf18-41988209ab07 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:38.760288 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-6c1f0d96-6a0e-4731-9296-f906c80bf351 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.227339 May 03 21:35:38.760854 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 423/915] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 3 21:35:38 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42/os-volume_attachments => generated 25 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 03 21:35:38.782700 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-3a40c524-77db-4f30-863e-60a66ffeb380 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:38.783160 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-3a40c524-77db-4f30-863e-60a66ffeb380 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:38.791882 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-3a40c524-77db-4f30-863e-60a66ffeb380 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:38.792375 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-3a40c524-77db-4f30-863e-60a66ffeb380 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:38.793249 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-3a40c524-77db-4f30-863e-60a66ffeb380 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:38.793650 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-3a40c524-77db-4f30-863e-60a66ffeb380 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:39.087796 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-80d63677-e60f-4cff-bf18-41988209ab07 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:39.118928 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-80d63677-e60f-4cff-bf18-41988209ab07 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:39.148236 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-80d63677-e60f-4cff-bf18-41988209ab07 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:39.151150 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-80d63677-e60f-4cff-bf18-41988209ab07 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1739 microversion: 2.20 time: 0.545192 May 03 21:35:39.152857 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 493/916] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:35:38 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1739 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:35:39.252513 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.wsgi [None req-3a40c524-77db-4f30-863e-60a66ffeb380 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] HTTP exception thrown: Instance f13ba9d5-9344-4748-8e24-118858bfce42 is not attached to volume 00f030a2-494e-4d19-8410-3ca3ef055bd5 May 03 21:35:39.256741 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-3a40c524-77db-4f30-863e-60a66ffeb380 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Returning 404 to user: Instance f13ba9d5-9344-4748-8e24-118858bfce42 is not attached to volume 00f030a2-494e-4d19-8410-3ca3ef055bd5 {{(pid=97831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:35:39.258463 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-3a40c524-77db-4f30-863e-60a66ffeb380 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42/os-volume_attachments/00f030a2-494e-4d19-8410-3ca3ef055bd5" status: 404 len: 154 microversion: 2.1 time: 0.489970 May 03 21:35:39.259341 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 424/917] 10.222.0.48 () {58 vars in 1415 bytes} [Tue May 3 21:35:38 2022] DELETE /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42/os-volume_attachments/00f030a2-494e-4d19-8410-3ca3ef055bd5 => generated 154 bytes in 492 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 21:35:40.183439 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-964bef42-e2e6-4cc3-bebc-0e2d61b51508 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:40.184180 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-964bef42-e2e6-4cc3-bebc-0e2d61b51508 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:40.192895 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-964bef42-e2e6-4cc3-bebc-0e2d61b51508 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:40.193462 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-964bef42-e2e6-4cc3-bebc-0e2d61b51508 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:40.194490 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-964bef42-e2e6-4cc3-bebc-0e2d61b51508 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:40.195129 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-964bef42-e2e6-4cc3-bebc-0e2d61b51508 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:40.464843 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-af4533d3-fff4-44e1-8ee6-e074913107a9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "caffed2d-4ab9-4236-b649-47f02fc1be5e"}} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:35:40.467402 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-af4533d3-fff4-44e1-8ee6-e074913107a9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:40.476640 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-af4533d3-fff4-44e1-8ee6-e074913107a9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:40.486100 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-964bef42-e2e6-4cc3-bebc-0e2d61b51508 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:40.488327 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-af4533d3-fff4-44e1-8ee6-e074913107a9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:40.492766 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-af4533d3-fff4-44e1-8ee6-e074913107a9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:40.493660 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-af4533d3-fff4-44e1-8ee6-e074913107a9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:40.521102 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-964bef42-e2e6-4cc3-bebc-0e2d61b51508 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:40.527887 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-964bef42-e2e6-4cc3-bebc-0e2d61b51508 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:40.529678 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-964bef42-e2e6-4cc3-bebc-0e2d61b51508 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1739 microversion: 2.20 time: 0.356946 May 03 21:35:40.536626 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 494/918] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:35:40 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1739 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:35:40.813554 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-21759a4e-1209-4b4c-8f0f-61ead386fd52 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:40.814363 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-21759a4e-1209-4b4c-8f0f-61ead386fd52 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:40.834220 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-21759a4e-1209-4b4c-8f0f-61ead386fd52 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:40.834968 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-21759a4e-1209-4b4c-8f0f-61ead386fd52 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:40.835971 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-21759a4e-1209-4b4c-8f0f-61ead386fd52 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:40.836633 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-21759a4e-1209-4b4c-8f0f-61ead386fd52 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:40.910852 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-21759a4e-1209-4b4c-8f0f-61ead386fd52 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Going to try to terminate instance {{(pid=97832) delete /opt/stack/nova/nova/compute/api.py:2559}} May 03 21:35:41.795952 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-21759a4e-1209-4b4c-8f0f-61ead386fd52 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 204 len: 0 microversion: 2.1 time: 0.992087 May 03 21:35:41.800355 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 495/919] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 3 21:35:40 2022] DELETE /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 0 bytes in 994 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 03 21:35:41.825270 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-4abf33a9-05a8-4bfa-87a7-0aa554cb552f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:41.827330 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-4abf33a9-05a8-4bfa-87a7-0aa554cb552f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:41.837232 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4abf33a9-05a8-4bfa-87a7-0aa554cb552f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:41.837991 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4abf33a9-05a8-4bfa-87a7-0aa554cb552f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:41.839040 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4abf33a9-05a8-4bfa-87a7-0aa554cb552f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:41.840217 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4abf33a9-05a8-4bfa-87a7-0aa554cb552f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:42.159052 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-4abf33a9-05a8-4bfa-87a7-0aa554cb552f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:42.183177 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-4abf33a9-05a8-4bfa-87a7-0aa554cb552f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:42.190639 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-4abf33a9-05a8-4bfa-87a7-0aa554cb552f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:42.192197 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-4abf33a9-05a8-4bfa-87a7-0aa554cb552f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1739 microversion: 2.20 time: 0.389610 May 03 21:35:42.193417 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 496/920] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:35:41 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1739 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:35:42.204166 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-f18c03f1-f2e0-47ab-97eb-c1a8c724f8b1 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:42.205134 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-f18c03f1-f2e0-47ab-97eb-c1a8c724f8b1 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:42.212982 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f18c03f1-f2e0-47ab-97eb-c1a8c724f8b1 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:42.219740 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f18c03f1-f2e0-47ab-97eb-c1a8c724f8b1 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:42.219740 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f18c03f1-f2e0-47ab-97eb-c1a8c724f8b1 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:42.219740 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f18c03f1-f2e0-47ab-97eb-c1a8c724f8b1 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:42.339530 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-af4533d3-fff4-44e1-8ee6-e074913107a9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "POST /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.887172 May 03 21:35:42.340316 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 425/921] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 3 21:35:40 2022] POST /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87/os-volume_attachments => generated 194 bytes in 1890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:35:42.920592 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-f18c03f1-f2e0-47ab-97eb-c1a8c724f8b1 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:42.937223 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-f18c03f1-f2e0-47ab-97eb-c1a8c724f8b1 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1553 microversion: 2.1 time: 0.742501 May 03 21:35:42.939160 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 497/922] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:42 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1553 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:35:43.221316 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-423009bb-5d0d-429e-8b98-3836e020e2af tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:43.222285 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-423009bb-5d0d-429e-8b98-3836e020e2af tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:43.236802 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-423009bb-5d0d-429e-8b98-3836e020e2af tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:43.237643 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-423009bb-5d0d-429e-8b98-3836e020e2af tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:43.238666 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-423009bb-5d0d-429e-8b98-3836e020e2af tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:43.239219 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-423009bb-5d0d-429e-8b98-3836e020e2af tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:43.573935 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-423009bb-5d0d-429e-8b98-3836e020e2af tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:43.598115 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-423009bb-5d0d-429e-8b98-3836e020e2af tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:43.605303 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-423009bb-5d0d-429e-8b98-3836e020e2af tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:43.608645 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-423009bb-5d0d-429e-8b98-3836e020e2af tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1739 microversion: 2.20 time: 0.396637 May 03 21:35:43.609909 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 426/923] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:35:43 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1739 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:35:43.967972 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-a388d5c9-9f54-4829-8e8e-96be15b7b642 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:43.969253 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-a388d5c9-9f54-4829-8e8e-96be15b7b642 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:43.982491 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a388d5c9-9f54-4829-8e8e-96be15b7b642 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:43.984354 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a388d5c9-9f54-4829-8e8e-96be15b7b642 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:43.997003 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a388d5c9-9f54-4829-8e8e-96be15b7b642 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:43.997003 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a388d5c9-9f54-4829-8e8e-96be15b7b642 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:44.399639 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-a388d5c9-9f54-4829-8e8e-96be15b7b642 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:44.412201 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-a388d5c9-9f54-4829-8e8e-96be15b7b642 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1553 microversion: 2.1 time: 0.459953 May 03 21:35:44.413136 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 498/924] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:43 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1553 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:35:44.639990 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-3b479a1c-3088-4175-9959-2cb059642821 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:44.643422 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-3b479a1c-3088-4175-9959-2cb059642821 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:44.667953 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-3b479a1c-3088-4175-9959-2cb059642821 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:44.670566 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-3b479a1c-3088-4175-9959-2cb059642821 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:44.673318 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-3b479a1c-3088-4175-9959-2cb059642821 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:44.673988 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-3b479a1c-3088-4175-9959-2cb059642821 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:45.233054 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-3b479a1c-3088-4175-9959-2cb059642821 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:45.252077 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-3b479a1c-3088-4175-9959-2cb059642821 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:45.260857 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-3b479a1c-3088-4175-9959-2cb059642821 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:45.262438 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-3b479a1c-3088-4175-9959-2cb059642821 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1739 microversion: 2.20 time: 0.636336 May 03 21:35:45.275498 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 427/925] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:35:44 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1739 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:35:45.437017 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-2f295da6-3604-4f29-9eb9-3021173135bc tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:45.438221 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-2f295da6-3604-4f29-9eb9-3021173135bc tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:45.445973 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2f295da6-3604-4f29-9eb9-3021173135bc tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:45.446678 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2f295da6-3604-4f29-9eb9-3021173135bc tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:45.447637 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2f295da6-3604-4f29-9eb9-3021173135bc tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:45.448223 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2f295da6-3604-4f29-9eb9-3021173135bc tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:45.456179 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-b60f98a3-09f0-4a30-a422-7ea1ca8b1971 req-da3b4dc9-4df2-4f50-9b59-031c4e692746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f13ba9d5-9344-4748-8e24-118858bfce42", "name": "network-vif-deleted", "tag": "85f0f545-6b51-41b2-a9ee-a8c17abc2f57"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:35:45.473758 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:35:45.473758 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:35:45.481422 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-b60f98a3-09f0-4a30-a422-7ea1ca8b1971 req-da3b4dc9-4df2-4f50-9b59-031c4e692746 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:45.482606 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-b60f98a3-09f0-4a30-a422-7ea1ca8b1971 req-da3b4dc9-4df2-4f50-9b59-031c4e692746 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:45.501005 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-b60f98a3-09f0-4a30-a422-7ea1ca8b1971 req-da3b4dc9-4df2-4f50-9b59-031c4e692746 service nova] Creating event network-vif-deleted:85f0f545-6b51-41b2-a9ee-a8c17abc2f57 for instance f13ba9d5-9344-4748-8e24-118858bfce42 on hv-cinder-84037 May 03 21:35:45.506587 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-b60f98a3-09f0-4a30-a422-7ea1ca8b1971 req-da3b4dc9-4df2-4f50-9b59-031c4e692746 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067877 May 03 21:35:45.507568 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 428/926] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:35:45.593424 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-2f295da6-3604-4f29-9eb9-3021173135bc tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:45.607385 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-2f295da6-3604-4f29-9eb9-3021173135bc tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1511 microversion: 2.1 time: 0.176228 May 03 21:35:45.607385 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 499/927] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:45 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1511 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:35:46.288762 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-2f3aab5c-2c5f-42bb-aa27-e3ec483ab5e3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:46.289471 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-2f3aab5c-2c5f-42bb-aa27-e3ec483ab5e3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:46.297245 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2f3aab5c-2c5f-42bb-aa27-e3ec483ab5e3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:46.297696 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2f3aab5c-2c5f-42bb-aa27-e3ec483ab5e3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:46.298519 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2f3aab5c-2c5f-42bb-aa27-e3ec483ab5e3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:46.298955 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2f3aab5c-2c5f-42bb-aa27-e3ec483ab5e3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:46.639565 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-056d80d7-92f9-4617-8677-2b32de4d2728 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:46.641084 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-056d80d7-92f9-4617-8677-2b32de4d2728 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:46.651132 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-056d80d7-92f9-4617-8677-2b32de4d2728 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:46.652017 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-056d80d7-92f9-4617-8677-2b32de4d2728 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:46.653131 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-056d80d7-92f9-4617-8677-2b32de4d2728 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:46.654544 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-056d80d7-92f9-4617-8677-2b32de4d2728 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:46.735808 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-2f3aab5c-2c5f-42bb-aa27-e3ec483ab5e3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:46.755661 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-2f3aab5c-2c5f-42bb-aa27-e3ec483ab5e3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:46.779927 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-2f3aab5c-2c5f-42bb-aa27-e3ec483ab5e3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:46.779927 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-2f3aab5c-2c5f-42bb-aa27-e3ec483ab5e3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1739 microversion: 2.20 time: 0.488139 May 03 21:35:46.779927 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 429/928] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:35:46 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1739 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:35:46.816657 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-056d80d7-92f9-4617-8677-2b32de4d2728 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac934f8b0ffc4d3ea5e32f2295de9741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03af834dfea4426086d2125bcea03d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:46.835765 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-056d80d7-92f9-4617-8677-2b32de4d2728 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 200 len: 1343 microversion: 2.1 time: 0.210055 May 03 21:35:46.836664 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 500/929] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:46 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 1343 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:35:47.826599 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-a6ad05ec-eb1c-4158-b52c-49808a0ec66d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:47.827244 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-a6ad05ec-eb1c-4158-b52c-49808a0ec66d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:47.834604 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a6ad05ec-eb1c-4158-b52c-49808a0ec66d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:47.835049 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a6ad05ec-eb1c-4158-b52c-49808a0ec66d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:47.835811 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a6ad05ec-eb1c-4158-b52c-49808a0ec66d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:47.836238 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a6ad05ec-eb1c-4158-b52c-49808a0ec66d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:47.863097 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-012381a2-6370-4f3b-b520-520f779718fd tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:47.863707 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-012381a2-6370-4f3b-b520-520f779718fd tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] [instance: f13ba9d5-9344-4748-8e24-118858bfce42] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:47.871878 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-012381a2-6370-4f3b-b520-520f779718fd tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:47.873119 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-012381a2-6370-4f3b-b520-520f779718fd tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:47.873906 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-012381a2-6370-4f3b-b520-520f779718fd tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:47.874338 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-012381a2-6370-4f3b-b520-520f779718fd tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:47.927458 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.wsgi [None req-012381a2-6370-4f3b-b520-520f779718fd tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] HTTP exception thrown: Instance f13ba9d5-9344-4748-8e24-118858bfce42 could not be found. May 03 21:35:47.928203 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-012381a2-6370-4f3b-b520-520f779718fd tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Returning 404 to user: Instance f13ba9d5-9344-4748-8e24-118858bfce42 could not be found. {{(pid=97832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:35:47.929310 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-012381a2-6370-4f3b-b520-520f779718fd tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42" status: 404 len: 111 microversion: 2.1 time: 0.076548 May 03 21:35:47.933005 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 501/930] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:47 2022] GET /compute/v2.1/servers/f13ba9d5-9344-4748-8e24-118858bfce42 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 03 21:35:47.946037 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-df2b70f1-90a8-43ba-9202-b13145215f39 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] Calling method '.version_select at 0x7fc84ce48a60>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:48.105070 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-df2b70f1-90a8-43ba-9202-b13145215f39 tempest-TestMinimumBasicScenario-1676527086 tempest-TestMinimumBasicScenario-1676527086-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1248110149" status: 202 len: 0 microversion: 2.1 time: 0.168047 May 03 21:35:48.106388 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 502/931] 10.222.0.48 () {58 vars in 1271 bytes} [Tue May 3 21:35:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1248110149 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 21:35:48.120223 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-a6ad05ec-eb1c-4158-b52c-49808a0ec66d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:48.157659 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-a6ad05ec-eb1c-4158-b52c-49808a0ec66d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:48.189468 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-a6ad05ec-eb1c-4158-b52c-49808a0ec66d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:48.193207 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-a6ad05ec-eb1c-4158-b52c-49808a0ec66d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1739 microversion: 2.20 time: 0.374569 May 03 21:35:48.194087 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 430/932] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:35:47 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1739 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:35:49.221898 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-24f61a4e-559e-4719-836a-1dc929c8ea14 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:49.223235 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-24f61a4e-559e-4719-836a-1dc929c8ea14 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:49.231554 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-24f61a4e-559e-4719-836a-1dc929c8ea14 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:49.232629 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-24f61a4e-559e-4719-836a-1dc929c8ea14 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:49.236075 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-24f61a4e-559e-4719-836a-1dc929c8ea14 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:49.236336 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-24f61a4e-559e-4719-836a-1dc929c8ea14 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:49.488298 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-24f61a4e-559e-4719-836a-1dc929c8ea14 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:49.504126 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-24f61a4e-559e-4719-836a-1dc929c8ea14 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:49.511543 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-24f61a4e-559e-4719-836a-1dc929c8ea14 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:49.511543 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-24f61a4e-559e-4719-836a-1dc929c8ea14 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1721 microversion: 2.20 time: 0.301254 May 03 21:35:49.512019 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 503/933] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:35:49 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1721 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:35:50.541781 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-c3ffbae8-53f2-4b45-aba2-3e5aaa0ef1e3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:50.542310 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-c3ffbae8-53f2-4b45-aba2-3e5aaa0ef1e3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:50.552475 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c3ffbae8-53f2-4b45-aba2-3e5aaa0ef1e3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:50.553421 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c3ffbae8-53f2-4b45-aba2-3e5aaa0ef1e3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:50.554294 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c3ffbae8-53f2-4b45-aba2-3e5aaa0ef1e3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:50.554879 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c3ffbae8-53f2-4b45-aba2-3e5aaa0ef1e3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:50.856052 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-c3ffbae8-53f2-4b45-aba2-3e5aaa0ef1e3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:50.871692 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-c3ffbae8-53f2-4b45-aba2-3e5aaa0ef1e3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:50.877551 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-c3ffbae8-53f2-4b45-aba2-3e5aaa0ef1e3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:50.878715 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-c3ffbae8-53f2-4b45-aba2-3e5aaa0ef1e3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1721 microversion: 2.20 time: 0.350688 May 03 21:35:50.879575 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 431/934] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:35:50 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1721 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:35:51.661027 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-00425edb-203a-4e10-b029-a9697f759c7d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:51.662070 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-00425edb-203a-4e10-b029-a9697f759c7d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:51.670306 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-00425edb-203a-4e10-b029-a9697f759c7d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:51.677915 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-00425edb-203a-4e10-b029-a9697f759c7d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:51.677915 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-00425edb-203a-4e10-b029-a9697f759c7d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:51.677915 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-00425edb-203a-4e10-b029-a9697f759c7d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:51.758108 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-00425edb-203a-4e10-b029-a9697f759c7d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.110668 May 03 21:35:51.759143 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 504/935] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 3 21:35:51 2022] GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87/os-volume_attachments => generated 371 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:35:51.907645 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-2b917a2d-f527-4c8b-82db-ca0d377dba26 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:51.908216 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-2b917a2d-f527-4c8b-82db-ca0d377dba26 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:51.915969 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2b917a2d-f527-4c8b-82db-ca0d377dba26 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:51.916420 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2b917a2d-f527-4c8b-82db-ca0d377dba26 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:51.917404 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2b917a2d-f527-4c8b-82db-ca0d377dba26 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:51.918020 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2b917a2d-f527-4c8b-82db-ca0d377dba26 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:51.919131 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-9ca85abb-72ee-4f6c-87f1-c1e74a30c73c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:51.919721 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-9ca85abb-72ee-4f6c-87f1-c1e74a30c73c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:51.931414 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9ca85abb-72ee-4f6c-87f1-c1e74a30c73c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:51.931966 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9ca85abb-72ee-4f6c-87f1-c1e74a30c73c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:51.932888 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9ca85abb-72ee-4f6c-87f1-c1e74a30c73c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:51.933411 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9ca85abb-72ee-4f6c-87f1-c1e74a30c73c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:52.020618 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-9ca85abb-72ee-4f6c-87f1-c1e74a30c73c tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87/os-volume_attachments/c16b3c62-08be-43c3-952a-6f5f50dc86e5" status: 200 len: 194 microversion: 2.1 time: 0.112022 May 03 21:35:52.021844 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 505/936] 10.222.0.48 () {58 vars in 1412 bytes} [Tue May 3 21:35:51 2022] GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87/os-volume_attachments/c16b3c62-08be-43c3-952a-6f5f50dc86e5 => generated 194 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:35:52.041680 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-a2d37f60-a673-491d-85f6-9c94d8da18f8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:52.043150 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-a2d37f60-a673-491d-85f6-9c94d8da18f8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:52.066707 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a2d37f60-a673-491d-85f6-9c94d8da18f8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:52.067152 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a2d37f60-a673-491d-85f6-9c94d8da18f8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:52.067947 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a2d37f60-a673-491d-85f6-9c94d8da18f8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:52.068376 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a2d37f60-a673-491d-85f6-9c94d8da18f8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:52.248403 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-2b917a2d-f527-4c8b-82db-ca0d377dba26 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:52.268216 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-2b917a2d-f527-4c8b-82db-ca0d377dba26 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:52.276748 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-2b917a2d-f527-4c8b-82db-ca0d377dba26 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:52.278598 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-2b917a2d-f527-4c8b-82db-ca0d377dba26 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1721 microversion: 2.20 time: 0.381855 May 03 21:35:52.279810 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 432/937] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:35:51 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1721 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:35:52.414417 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-43b788d7-a518-4073-b61b-c58eabe67a21 req-e6ceec92-8412-4e8f-b1a0-63a886d16951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49b86a80-657d-4e94-bc71-bcfe8f276469", "name": "network-vif-unplugged", "status": "completed", "tag": "4a088512-8058-4a9a-a45b-177671d97cfc"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:35:52.420838 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:35:52.420838 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:35:52.429252 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-43b788d7-a518-4073-b61b-c58eabe67a21 req-e6ceec92-8412-4e8f-b1a0-63a886d16951 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:52.429694 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-43b788d7-a518-4073-b61b-c58eabe67a21 req-e6ceec92-8412-4e8f-b1a0-63a886d16951 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:52.448016 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-43b788d7-a518-4073-b61b-c58eabe67a21 req-e6ceec92-8412-4e8f-b1a0-63a886d16951 service nova] Creating event network-vif-unplugged:4a088512-8058-4a9a-a45b-177671d97cfc for instance 49b86a80-657d-4e94-bc71-bcfe8f276469 on hv-cinder-84037 May 03 21:35:52.453534 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-43b788d7-a518-4073-b61b-c58eabe67a21 req-e6ceec92-8412-4e8f-b1a0-63a886d16951 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048584 May 03 21:35:52.454366 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 433/938] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:35:52.673303 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-a2d37f60-a673-491d-85f6-9c94d8da18f8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "DELETE /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87/os-volume_attachments/c16b3c62-08be-43c3-952a-6f5f50dc86e5" status: 202 len: 0 microversion: 2.1 time: 0.638128 May 03 21:35:52.673303 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 506/939] 10.222.0.48 () {58 vars in 1415 bytes} [Tue May 3 21:35:52 2022] DELETE /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87/os-volume_attachments/c16b3c62-08be-43c3-952a-6f5f50dc86e5 => generated 0 bytes in 640 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 21:35:53.304007 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-f195dc51-a6c8-445e-94a8-e110fc948db7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:53.304840 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-f195dc51-a6c8-445e-94a8-e110fc948db7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:53.313922 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f195dc51-a6c8-445e-94a8-e110fc948db7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:53.314596 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f195dc51-a6c8-445e-94a8-e110fc948db7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:53.315619 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f195dc51-a6c8-445e-94a8-e110fc948db7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:53.316104 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f195dc51-a6c8-445e-94a8-e110fc948db7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:53.611081 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-f195dc51-a6c8-445e-94a8-e110fc948db7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:53.647235 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-f195dc51-a6c8-445e-94a8-e110fc948db7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:53.662501 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-f195dc51-a6c8-445e-94a8-e110fc948db7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:53.664687 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-f195dc51-a6c8-445e-94a8-e110fc948db7 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1664 microversion: 2.20 time: 0.371293 May 03 21:35:53.665716 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 434/940] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:35:53 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1664 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:35:53.697778 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-ab79934e-74d6-4c90-88a1-b015c0a44867 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae175ca9-1da2-4872-8d31-b25b7ba20da1"}} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:35:53.699018 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-ab79934e-74d6-4c90-88a1-b015c0a44867 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:53.707817 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ab79934e-74d6-4c90-88a1-b015c0a44867 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:53.708592 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ab79934e-74d6-4c90-88a1-b015c0a44867 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:53.714779 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ab79934e-74d6-4c90-88a1-b015c0a44867 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:53.714779 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ab79934e-74d6-4c90-88a1-b015c0a44867 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:55.093300 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-a646f86d-623d-4904-9ceb-6d0ff6fcd26f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:55.095156 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-a646f86d-623d-4904-9ceb-6d0ff6fcd26f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:55.111681 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a646f86d-623d-4904-9ceb-6d0ff6fcd26f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:55.114368 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a646f86d-623d-4904-9ceb-6d0ff6fcd26f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:55.114368 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a646f86d-623d-4904-9ceb-6d0ff6fcd26f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:55.115091 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a646f86d-623d-4904-9ceb-6d0ff6fcd26f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:55.131624 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-ab79934e-74d6-4c90-88a1-b015c0a44867 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "POST /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.444145 May 03 21:35:55.132365 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 507/941] 10.222.0.48 () {62 vars in 1363 bytes} [Tue May 3 21:35:53 2022] POST /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469/os-volume_attachments => generated 188 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 03 21:35:55.228920 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-a646f86d-623d-4904-9ceb-6d0ff6fcd26f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87/os-volume_attachments/caffed2d-4ab9-4236-b649-47f02fc1be5e" status: 200 len: 194 microversion: 2.1 time: 0.162265 May 03 21:35:55.237533 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 435/942] 10.222.0.48 () {58 vars in 1412 bytes} [Tue May 3 21:35:55 2022] GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87/os-volume_attachments/caffed2d-4ab9-4236-b649-47f02fc1be5e => generated 194 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:35:55.249196 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-7f6ed5e4-aa2c-4ed8-828e-1af755bdcefd tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:55.249811 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-7f6ed5e4-aa2c-4ed8-828e-1af755bdcefd tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:55.259758 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7f6ed5e4-aa2c-4ed8-828e-1af755bdcefd tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:55.260372 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7f6ed5e4-aa2c-4ed8-828e-1af755bdcefd tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:55.261195 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7f6ed5e4-aa2c-4ed8-828e-1af755bdcefd tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:55.261630 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7f6ed5e4-aa2c-4ed8-828e-1af755bdcefd tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:55.433983 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-7de2f399-ab1e-4340-83f0-4b1352875438 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:55.435180 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-7de2f399-ab1e-4340-83f0-4b1352875438 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:55.444574 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7de2f399-ab1e-4340-83f0-4b1352875438 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:55.445041 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7de2f399-ab1e-4340-83f0-4b1352875438 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:55.450523 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7de2f399-ab1e-4340-83f0-4b1352875438 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:55.450523 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7de2f399-ab1e-4340-83f0-4b1352875438 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:56.029435 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-7f6ed5e4-aa2c-4ed8-828e-1af755bdcefd tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "DELETE /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87/os-volume_attachments/caffed2d-4ab9-4236-b649-47f02fc1be5e" status: 202 len: 0 microversion: 2.1 time: 0.790165 May 03 21:35:56.030308 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 508/943] 10.222.0.48 () {58 vars in 1415 bytes} [Tue May 3 21:35:55 2022] DELETE /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87/os-volume_attachments/caffed2d-4ab9-4236-b649-47f02fc1be5e => generated 0 bytes in 792 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 21:35:56.697087 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-7de2f399-ab1e-4340-83f0-4b1352875438 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "DELETE /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469/os-volume_attachments/ae175ca9-1da2-4872-8d31-b25b7ba20da1" status: 202 len: 0 microversion: 2.20 time: 1.278335 May 03 21:35:56.698041 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 436/944] 10.222.0.48 () {60 vars in 1456 bytes} [Tue May 3 21:35:55 2022] DELETE /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469/os-volume_attachments/ae175ca9-1da2-4872-8d31-b25b7ba20da1 => generated 0 bytes in 1280 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 03 21:35:56.850571 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-c99ba202-d62a-4580-869d-2d794de66561 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:35:56.851988 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-c99ba202-d62a-4580-869d-2d794de66561 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:56.861662 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c99ba202-d62a-4580-869d-2d794de66561 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:56.862548 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c99ba202-d62a-4580-869d-2d794de66561 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:56.863628 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c99ba202-d62a-4580-869d-2d794de66561 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:56.864226 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c99ba202-d62a-4580-869d-2d794de66561 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:57.348199 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-c99ba202-d62a-4580-869d-2d794de66561 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "POST /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469/action" status: 202 len: 0 microversion: 2.20 time: 0.509603 May 03 21:35:57.350163 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 509/945] 10.222.0.48 () {62 vars in 1318 bytes} [Tue May 3 21:35:56 2022] POST /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469/action => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 03 21:35:57.382197 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-50e41505-0473-42b1-87c6-210af334fdab tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:57.383708 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-50e41505-0473-42b1-87c6-210af334fdab tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:57.399065 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-50e41505-0473-42b1-87c6-210af334fdab tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:57.400377 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-50e41505-0473-42b1-87c6-210af334fdab tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:57.401546 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-50e41505-0473-42b1-87c6-210af334fdab tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:57.404402 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-50e41505-0473-42b1-87c6-210af334fdab tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:57.736473 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-50e41505-0473-42b1-87c6-210af334fdab tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:57.751497 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-50e41505-0473-42b1-87c6-210af334fdab tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:57.757828 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-50e41505-0473-42b1-87c6-210af334fdab tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:57.759014 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-50e41505-0473-42b1-87c6-210af334fdab tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1672 microversion: 2.20 time: 0.402215 May 03 21:35:57.759637 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 437/946] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:35:57 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1672 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:35:58.442680 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-139957ac-52b6-4fae-9655-80f9870f234f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:58.444516 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-139957ac-52b6-4fae-9655-80f9870f234f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:58.452674 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-139957ac-52b6-4fae-9655-80f9870f234f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:58.453433 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-139957ac-52b6-4fae-9655-80f9870f234f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:58.454482 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-139957ac-52b6-4fae-9655-80f9870f234f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:58.455123 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-139957ac-52b6-4fae-9655-80f9870f234f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:58.546950 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-139957ac-52b6-4fae-9655-80f9870f234f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.114141 May 03 21:35:58.554401 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 510/947] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 3 21:35:58 2022] GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87/os-volume_attachments => generated 25 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 03 21:35:58.805441 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-cd91f3e3-39b8-41a0-a947-3e641c931b32 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:58.805441 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-cd91f3e3-39b8-41a0-a947-3e641c931b32 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:58.821462 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-cd91f3e3-39b8-41a0-a947-3e641c931b32 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:58.822331 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-cd91f3e3-39b8-41a0-a947-3e641c931b32 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:58.823903 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-cd91f3e3-39b8-41a0-a947-3e641c931b32 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:58.824947 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-cd91f3e3-39b8-41a0-a947-3e641c931b32 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:58.835769 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-f0cea483-e72a-4b16-a47d-2a8e2c82ec85 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:58.841721 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-f0cea483-e72a-4b16-a47d-2a8e2c82ec85 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:58.860823 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f0cea483-e72a-4b16-a47d-2a8e2c82ec85 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:58.868206 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f0cea483-e72a-4b16-a47d-2a8e2c82ec85 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:58.869252 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f0cea483-e72a-4b16-a47d-2a8e2c82ec85 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:58.870072 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f0cea483-e72a-4b16-a47d-2a8e2c82ec85 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:58.989431 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-f0cea483-e72a-4b16-a47d-2a8e2c82ec85 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.180716 May 03 21:35:58.990093 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 511/948] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 3 21:35:58 2022] GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87/os-volume_attachments => generated 25 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 03 21:35:59.152888 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-cd91f3e3-39b8-41a0-a947-3e641c931b32 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:59.152888 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-cd91f3e3-39b8-41a0-a947-3e641c931b32 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:59.161889 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-cd91f3e3-39b8-41a0-a947-3e641c931b32 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:35:59.163041 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-cd91f3e3-39b8-41a0-a947-3e641c931b32 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1672 microversion: 2.20 time: 0.388253 May 03 21:35:59.163574 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 438/949] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:35:58 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1672 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:35:59.164080 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-297d692a-24de-40fc-9705-3b413572dffa tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:59.164623 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-297d692a-24de-40fc-9705-3b413572dffa tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:59.173129 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-297d692a-24de-40fc-9705-3b413572dffa tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:59.173669 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-297d692a-24de-40fc-9705-3b413572dffa tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:59.174476 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-297d692a-24de-40fc-9705-3b413572dffa tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:59.175091 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-297d692a-24de-40fc-9705-3b413572dffa tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:59.250620 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-297d692a-24de-40fc-9705-3b413572dffa tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Going to try to terminate instance {{(pid=97832) delete /opt/stack/nova/nova/compute/api.py:2559}} May 03 21:35:59.635465 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-297d692a-24de-40fc-9705-3b413572dffa tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "DELETE /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87" status: 204 len: 0 microversion: 2.1 time: 0.480738 May 03 21:35:59.636655 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 512/950] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 3 21:35:59 2022] DELETE /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 03 21:35:59.650044 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-6d6efd44-3d6a-4768-834a-40b0747f1a4f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:35:59.650911 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-6d6efd44-3d6a-4768-834a-40b0747f1a4f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:35:59.658940 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6d6efd44-3d6a-4768-834a-40b0747f1a4f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:59.659382 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6d6efd44-3d6a-4768-834a-40b0747f1a4f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:35:59.660360 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6d6efd44-3d6a-4768-834a-40b0747f1a4f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:35:59.660810 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6d6efd44-3d6a-4768-834a-40b0747f1a4f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:00.190326 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-26cd6f78-ad54-4dc8-a04f-21ab71b188d3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:00.191035 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-26cd6f78-ad54-4dc8-a04f-21ab71b188d3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:00.198669 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-26cd6f78-ad54-4dc8-a04f-21ab71b188d3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:00.199174 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-26cd6f78-ad54-4dc8-a04f-21ab71b188d3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:00.208125 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-26cd6f78-ad54-4dc8-a04f-21ab71b188d3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:00.208125 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-26cd6f78-ad54-4dc8-a04f-21ab71b188d3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:00.265919 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-6d6efd44-3d6a-4768-834a-40b0747f1a4f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:00.295368 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-6d6efd44-3d6a-4768-834a-40b0747f1a4f tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87" status: 200 len: 1672 microversion: 2.1 time: 0.646003 May 03 21:36:00.297812 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 439/951] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:35:59 2022] GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87 => generated 1672 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:36:00.424571 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-26cd6f78-ad54-4dc8-a04f-21ab71b188d3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:00.443407 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-26cd6f78-ad54-4dc8-a04f-21ab71b188d3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:00.450701 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-26cd6f78-ad54-4dc8-a04f-21ab71b188d3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:00.451911 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-26cd6f78-ad54-4dc8-a04f-21ab71b188d3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1674 microversion: 2.20 time: 0.272825 May 03 21:36:00.456465 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 513/952] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:36:00 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1674 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 21:36:01.320265 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-d1e592e6-e540-4feb-a317-bb474172725d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:01.320901 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-d1e592e6-e540-4feb-a317-bb474172725d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:01.329577 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d1e592e6-e540-4feb-a317-bb474172725d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:01.330370 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d1e592e6-e540-4feb-a317-bb474172725d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:01.331320 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d1e592e6-e540-4feb-a317-bb474172725d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:01.331898 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d1e592e6-e540-4feb-a317-bb474172725d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:01.483602 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-5d88af95-1e19-4a19-b160-876c9d80b3bc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:01.485570 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-5d88af95-1e19-4a19-b160-876c9d80b3bc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:01.498831 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5d88af95-1e19-4a19-b160-876c9d80b3bc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:01.499548 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5d88af95-1e19-4a19-b160-876c9d80b3bc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:01.500737 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5d88af95-1e19-4a19-b160-876c9d80b3bc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:01.501302 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5d88af95-1e19-4a19-b160-876c9d80b3bc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:01.740082 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-5d88af95-1e19-4a19-b160-876c9d80b3bc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:01.759241 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-5d88af95-1e19-4a19-b160-876c9d80b3bc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:01.767255 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-5d88af95-1e19-4a19-b160-876c9d80b3bc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:01.768497 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-5d88af95-1e19-4a19-b160-876c9d80b3bc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1674 microversion: 2.20 time: 0.300035 May 03 21:36:01.781168 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 514/953] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:36:01 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1674 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:36:02.063496 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-d1e592e6-e540-4feb-a317-bb474172725d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:02.063496 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-d1e592e6-e540-4feb-a317-bb474172725d tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87" status: 200 len: 1672 microversion: 2.1 time: 0.568412 May 03 21:36:02.063496 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 440/954] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:01 2022] GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87 => generated 1672 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:36:02.794465 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-3efbd53c-6ccc-4019-831e-ba7d537d871d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:02.795712 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-3efbd53c-6ccc-4019-831e-ba7d537d871d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:02.803292 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3efbd53c-6ccc-4019-831e-ba7d537d871d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:02.803739 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3efbd53c-6ccc-4019-831e-ba7d537d871d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:02.804555 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3efbd53c-6ccc-4019-831e-ba7d537d871d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:02.804996 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3efbd53c-6ccc-4019-831e-ba7d537d871d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:03.077214 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-4faa065c-abbd-44cf-8abc-375409d9cbab tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:03.081526 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-4faa065c-abbd-44cf-8abc-375409d9cbab tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:03.092893 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4faa065c-abbd-44cf-8abc-375409d9cbab tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:03.093348 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4faa065c-abbd-44cf-8abc-375409d9cbab tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:03.097233 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4faa065c-abbd-44cf-8abc-375409d9cbab tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:03.097692 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4faa065c-abbd-44cf-8abc-375409d9cbab tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:03.342224 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-3efbd53c-6ccc-4019-831e-ba7d537d871d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:03.342224 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-3efbd53c-6ccc-4019-831e-ba7d537d871d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:03.343948 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-3efbd53c-6ccc-4019-831e-ba7d537d871d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:03.343948 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-3efbd53c-6ccc-4019-831e-ba7d537d871d tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1730 microversion: 2.20 time: 0.539563 May 03 21:36:03.343948 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 515/955] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:36:02 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1730 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:36:03.703316 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-fd77f105-2160-4174-ab1b-3298f2cb17d3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:03.703819 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-fd77f105-2160-4174-ab1b-3298f2cb17d3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: c8f9aa7c-153d-482a-b048-18cd034d21cb] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:03.715819 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fd77f105-2160-4174-ab1b-3298f2cb17d3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:03.717296 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fd77f105-2160-4174-ab1b-3298f2cb17d3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:03.717296 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fd77f105-2160-4174-ab1b-3298f2cb17d3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:03.718922 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fd77f105-2160-4174-ab1b-3298f2cb17d3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:03.895265 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-4faa065c-abbd-44cf-8abc-375409d9cbab tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:03.895265 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-4faa065c-abbd-44cf-8abc-375409d9cbab tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87" status: 200 len: 1672 microversion: 2.1 time: 0.819400 May 03 21:36:03.895265 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 441/956] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:03 2022] GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87 => generated 1672 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:36:03.940620 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-fd77f105-2160-4174-ab1b-3298f2cb17d3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb/ips" status: 200 len: 149 microversion: 2.1 time: 0.249316 May 03 21:36:03.942418 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 516/957] 10.222.0.48 () {58 vars in 1247 bytes} [Tue May 3 21:36:03 2022] GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb/ips => generated 149 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:36:04.351610 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-b307946a-774e-42c6-bcdd-403d9e5c93dc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:04.352255 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-b307946a-774e-42c6-bcdd-403d9e5c93dc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:04.390861 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b307946a-774e-42c6-bcdd-403d9e5c93dc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:04.392189 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b307946a-774e-42c6-bcdd-403d9e5c93dc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:04.394379 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b307946a-774e-42c6-bcdd-403d9e5c93dc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:04.396099 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b307946a-774e-42c6-bcdd-403d9e5c93dc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:04.916015 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-5985d737-4904-49d2-8ca3-eb2693737202 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:04.916676 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-5985d737-4904-49d2-8ca3-eb2693737202 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:04.925580 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5985d737-4904-49d2-8ca3-eb2693737202 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:04.926313 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5985d737-4904-49d2-8ca3-eb2693737202 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:04.927282 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5985d737-4904-49d2-8ca3-eb2693737202 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:04.927919 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5985d737-4904-49d2-8ca3-eb2693737202 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:05.217827 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-b307946a-774e-42c6-bcdd-403d9e5c93dc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:05.243518 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-5985d737-4904-49d2-8ca3-eb2693737202 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:05.266964 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-b307946a-774e-42c6-bcdd-403d9e5c93dc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:05.271678 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-5985d737-4904-49d2-8ca3-eb2693737202 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87" status: 200 len: 1605 microversion: 2.1 time: 0.370278 May 03 21:36:05.280884 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 517/958] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:04 2022] GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87 => generated 1605 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:36:05.283865 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-b307946a-774e-42c6-bcdd-403d9e5c93dc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:05.289318 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-b307946a-774e-42c6-bcdd-403d9e5c93dc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1730 microversion: 2.20 time: 0.949279 May 03 21:36:05.291384 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 442/959] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:36:04 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1730 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:36:05.842912 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-808486a8-baee-4ab6-a261-dc87eecd8e98 req-d875db96-5e66-496e-9af3-f41f51c316a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab2b795-8567-48fa-81d6-985a8f168f87", "name": "network-vif-deleted", "tag": "0467bd1c-73a7-463d-8aa3-9018ce655dae"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:36:05.858670 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:36:05.858670 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:36:05.881575 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-808486a8-baee-4ab6-a261-dc87eecd8e98 req-d875db96-5e66-496e-9af3-f41f51c316a0 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:05.885286 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-808486a8-baee-4ab6-a261-dc87eecd8e98 req-d875db96-5e66-496e-9af3-f41f51c316a0 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:05.947242 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-808486a8-baee-4ab6-a261-dc87eecd8e98 req-d875db96-5e66-496e-9af3-f41f51c316a0 service nova] Creating event network-vif-deleted:0467bd1c-73a7-463d-8aa3-9018ce655dae for instance aab2b795-8567-48fa-81d6-985a8f168f87 on hv-cinder-84037 May 03 21:36:05.959759 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-808486a8-baee-4ab6-a261-dc87eecd8e98 req-d875db96-5e66-496e-9af3-f41f51c316a0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153718 May 03 21:36:05.960501 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 518/960] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:36:06.316101 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-54db316b-a855-416d-b840-b981de62e6bc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:06.319786 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-2a5c7654-d933-4436-95a7-dfcdaba84831 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:06.320417 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-2a5c7654-d933-4436-95a7-dfcdaba84831 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:06.327160 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-54db316b-a855-416d-b840-b981de62e6bc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:06.357162 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-54db316b-a855-416d-b840-b981de62e6bc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:06.361236 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-54db316b-a855-416d-b840-b981de62e6bc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:06.361236 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-54db316b-a855-416d-b840-b981de62e6bc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:06.361236 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-54db316b-a855-416d-b840-b981de62e6bc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:06.382214 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2a5c7654-d933-4436-95a7-dfcdaba84831 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:06.383319 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2a5c7654-d933-4436-95a7-dfcdaba84831 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:06.384878 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2a5c7654-d933-4436-95a7-dfcdaba84831 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:06.386592 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2a5c7654-d933-4436-95a7-dfcdaba84831 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:06.609705 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2a5c7654-d933-4436-95a7-dfcdaba84831 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:06.611439 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2a5c7654-d933-4436-95a7-dfcdaba84831 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:06.612249 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.objects.instance [None req-2a5c7654-d933-4436-95a7-dfcdaba84831 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lazy-loading 'fault' on Instance uuid aab2b795-8567-48fa-81d6-985a8f168f87 {{(pid=97831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 03 21:36:06.903596 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-2a5c7654-d933-4436-95a7-dfcdaba84831 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:06.920378 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-2a5c7654-d933-4436-95a7-dfcdaba84831 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87" status: 200 len: 1327 microversion: 2.1 time: 0.630392 May 03 21:36:06.922749 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 443/961] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:06 2022] GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87 => generated 1327 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:36:06.970692 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-9246d6b2-6fbb-422a-b63b-e71ff2f7f95e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8930102-fbea-4916-8167-25cc3ea1bdd7"}} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:36:06.973966 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-9246d6b2-6fbb-422a-b63b-e71ff2f7f95e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: c8f9aa7c-153d-482a-b048-18cd034d21cb] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:07.017946 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9246d6b2-6fbb-422a-b63b-e71ff2f7f95e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:07.019048 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9246d6b2-6fbb-422a-b63b-e71ff2f7f95e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:07.020753 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9246d6b2-6fbb-422a-b63b-e71ff2f7f95e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:07.021807 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9246d6b2-6fbb-422a-b63b-e71ff2f7f95e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:07.264945 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-54db316b-a855-416d-b840-b981de62e6bc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:07.283012 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-54db316b-a855-416d-b840-b981de62e6bc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:07.290322 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-54db316b-a855-416d-b840-b981de62e6bc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:07.292772 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-54db316b-a855-416d-b840-b981de62e6bc tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1730 microversion: 2.20 time: 0.987277 May 03 21:36:07.294786 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 519/962] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:36:06 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1730 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:36:07.973505 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-36fa61db-1976-4c34-8249-841528f0a834 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:07.974208 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-36fa61db-1976-4c34-8249-841528f0a834 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:08.006098 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-36fa61db-1976-4c34-8249-841528f0a834 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:08.006554 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-36fa61db-1976-4c34-8249-841528f0a834 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:08.010501 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-36fa61db-1976-4c34-8249-841528f0a834 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:08.010501 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-36fa61db-1976-4c34-8249-841528f0a834 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:08.328252 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-36fa61db-1976-4c34-8249-841528f0a834 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:08.329311 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-36fa61db-1976-4c34-8249-841528f0a834 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:08.330257 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.objects.instance [None req-36fa61db-1976-4c34-8249-841528f0a834 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lazy-loading 'fault' on Instance uuid aab2b795-8567-48fa-81d6-985a8f168f87 {{(pid=97832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 03 21:36:08.451920 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-36fa61db-1976-4c34-8249-841528f0a834 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649d5374c0ae4842853cd3b425d1d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2df1ca790224a009004c3c22a5ee5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:08.485324 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-36fa61db-1976-4c34-8249-841528f0a834 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87" status: 200 len: 1327 microversion: 2.1 time: 0.545940 May 03 21:36:08.490243 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 520/963] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:07 2022] GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87 => generated 1327 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:36:08.519333 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-2829b2bc-f132-4bfb-93a9-322532f56a3c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:08.520169 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-2829b2bc-f132-4bfb-93a9-322532f56a3c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:08.540310 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2829b2bc-f132-4bfb-93a9-322532f56a3c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:08.541315 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2829b2bc-f132-4bfb-93a9-322532f56a3c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:08.542743 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2829b2bc-f132-4bfb-93a9-322532f56a3c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:08.547609 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2829b2bc-f132-4bfb-93a9-322532f56a3c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:08.724682 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-9246d6b2-6fbb-422a-b63b-e71ff2f7f95e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "POST /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.800221 May 03 21:36:08.726529 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 444/964] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 3 21:36:06 2022] POST /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb/os-volume_attachments => generated 194 bytes in 1803 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:36:09.547281 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-c58a4eb2-fdca-48e6-935c-45f0f1e63ca8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:09.549665 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-c58a4eb2-fdca-48e6-935c-45f0f1e63ca8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:09.622589 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c58a4eb2-fdca-48e6-935c-45f0f1e63ca8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:09.626471 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c58a4eb2-fdca-48e6-935c-45f0f1e63ca8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:09.630790 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c58a4eb2-fdca-48e6-935c-45f0f1e63ca8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:09.641320 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c58a4eb2-fdca-48e6-935c-45f0f1e63ca8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:09.706565 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-2829b2bc-f132-4bfb-93a9-322532f56a3c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:09.747456 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-2829b2bc-f132-4bfb-93a9-322532f56a3c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:09.750573 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-2829b2bc-f132-4bfb-93a9-322532f56a3c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:09.752098 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-2829b2bc-f132-4bfb-93a9-322532f56a3c tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1730 microversion: 2.20 time: 1.259918 May 03 21:36:09.753227 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 521/965] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:36:08 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1730 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:36:09.755782 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.wsgi [None req-c58a4eb2-fdca-48e6-935c-45f0f1e63ca8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] HTTP exception thrown: Instance aab2b795-8567-48fa-81d6-985a8f168f87 could not be found. May 03 21:36:09.756476 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-c58a4eb2-fdca-48e6-935c-45f0f1e63ca8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Returning 404 to user: Instance aab2b795-8567-48fa-81d6-985a8f168f87 could not be found. {{(pid=97831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:36:09.757930 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-c58a4eb2-fdca-48e6-935c-45f0f1e63ca8 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87" status: 404 len: 111 microversion: 2.1 time: 0.254151 May 03 21:36:09.759439 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 445/966] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:09 2022] GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87 => generated 111 bytes in 257 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 21:36:09.787140 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-8994a996-33f3-4a61-89d7-dcd2dd91d040 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '.version_select at 0x7fc84cce65e0>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:09.886928 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-8994a996-33f3-4a61-89d7-dcd2dd91d040 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1141467559" status: 202 len: 0 microversion: 2.1 time: 0.121525 May 03 21:36:09.889759 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 522/967] 10.222.0.48 () {58 vars in 1220 bytes} [Tue May 3 21:36:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1141467559 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 21:36:10.791720 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-fb7c4c9f-077e-4335-a83f-2ad150758fd4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:10.791720 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-fb7c4c9f-077e-4335-a83f-2ad150758fd4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:10.803472 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fb7c4c9f-077e-4335-a83f-2ad150758fd4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:10.804063 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fb7c4c9f-077e-4335-a83f-2ad150758fd4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:10.805162 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fb7c4c9f-077e-4335-a83f-2ad150758fd4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:10.805684 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fb7c4c9f-077e-4335-a83f-2ad150758fd4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:11.457111 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-fb7c4c9f-077e-4335-a83f-2ad150758fd4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:11.495883 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-fb7c4c9f-077e-4335-a83f-2ad150758fd4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:11.516461 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-fb7c4c9f-077e-4335-a83f-2ad150758fd4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:11.520158 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-fb7c4c9f-077e-4335-a83f-2ad150758fd4 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1730 microversion: 2.20 time: 0.747783 May 03 21:36:11.536558 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 446/968] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:36:10 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1730 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:36:12.563402 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-b9ee4490-cf52-4556-afb4-783c784c9d17 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:12.564860 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-b9ee4490-cf52-4556-afb4-783c784c9d17 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:12.576778 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b9ee4490-cf52-4556-afb4-783c784c9d17 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:12.578215 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b9ee4490-cf52-4556-afb4-783c784c9d17 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:12.579198 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b9ee4490-cf52-4556-afb4-783c784c9d17 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:12.579928 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b9ee4490-cf52-4556-afb4-783c784c9d17 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:13.118353 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-b9ee4490-cf52-4556-afb4-783c784c9d17 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:13.139417 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-b9ee4490-cf52-4556-afb4-783c784c9d17 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:13.147362 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-b9ee4490-cf52-4556-afb4-783c784c9d17 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:13.149357 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-b9ee4490-cf52-4556-afb4-783c784c9d17 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1730 microversion: 2.20 time: 0.604084 May 03 21:36:13.150257 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 523/969] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:36:12 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1730 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 21:36:14.186568 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-a864e295-80ae-491c-9abc-4f6cc9b03a25 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:14.187301 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-a864e295-80ae-491c-9abc-4f6cc9b03a25 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:14.201786 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a864e295-80ae-491c-9abc-4f6cc9b03a25 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:14.203298 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a864e295-80ae-491c-9abc-4f6cc9b03a25 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:14.205385 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a864e295-80ae-491c-9abc-4f6cc9b03a25 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:14.206551 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a864e295-80ae-491c-9abc-4f6cc9b03a25 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:14.637348 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-a864e295-80ae-491c-9abc-4f6cc9b03a25 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:14.672556 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-a864e295-80ae-491c-9abc-4f6cc9b03a25 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:14.680684 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-a864e295-80ae-491c-9abc-4f6cc9b03a25 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:14.680684 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-a864e295-80ae-491c-9abc-4f6cc9b03a25 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1730 microversion: 2.20 time: 0.505705 May 03 21:36:14.691757 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 447/970] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:36:14 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1730 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:36:15.706350 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-fac4426d-4295-4cc1-8ee0-65377cdf5784 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:15.707984 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-fac4426d-4295-4cc1-8ee0-65377cdf5784 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:15.717737 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fac4426d-4295-4cc1-8ee0-65377cdf5784 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:15.718473 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fac4426d-4295-4cc1-8ee0-65377cdf5784 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:15.719474 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fac4426d-4295-4cc1-8ee0-65377cdf5784 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:15.719896 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fac4426d-4295-4cc1-8ee0-65377cdf5784 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:15.936953 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-fac4426d-4295-4cc1-8ee0-65377cdf5784 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:15.950562 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-fac4426d-4295-4cc1-8ee0-65377cdf5784 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:15.956646 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-fac4426d-4295-4cc1-8ee0-65377cdf5784 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:15.957770 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-fac4426d-4295-4cc1-8ee0-65377cdf5784 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1730 microversion: 2.20 time: 0.262031 May 03 21:36:15.958301 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 524/971] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:36:15 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1730 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:36:16.983036 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-38825e47-3108-4211-819e-d96d3c26f07f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:16.983674 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-38825e47-3108-4211-819e-d96d3c26f07f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:16.991378 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-38825e47-3108-4211-819e-d96d3c26f07f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:16.991816 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-38825e47-3108-4211-819e-d96d3c26f07f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:16.992647 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-38825e47-3108-4211-819e-d96d3c26f07f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:16.993086 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-38825e47-3108-4211-819e-d96d3c26f07f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:17.208182 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-38825e47-3108-4211-819e-d96d3c26f07f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:17.223557 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-38825e47-3108-4211-819e-d96d3c26f07f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:17.230131 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-38825e47-3108-4211-819e-d96d3c26f07f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:17.232342 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-38825e47-3108-4211-819e-d96d3c26f07f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1730 microversion: 2.20 time: 0.259634 May 03 21:36:17.232933 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 448/972] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:36:16 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1730 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:36:18.257179 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-2be294d0-25b4-403e-91d5-6b51d428aecd tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:18.257893 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-2be294d0-25b4-403e-91d5-6b51d428aecd tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:18.267806 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2be294d0-25b4-403e-91d5-6b51d428aecd tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:18.268409 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2be294d0-25b4-403e-91d5-6b51d428aecd tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:18.269394 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2be294d0-25b4-403e-91d5-6b51d428aecd tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:18.269903 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2be294d0-25b4-403e-91d5-6b51d428aecd tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:18.513733 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-2be294d0-25b4-403e-91d5-6b51d428aecd tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:18.539968 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-2be294d0-25b4-403e-91d5-6b51d428aecd tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:18.551266 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-2be294d0-25b4-403e-91d5-6b51d428aecd tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:18.552839 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-2be294d0-25b4-403e-91d5-6b51d428aecd tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1730 microversion: 2.20 time: 0.304911 May 03 21:36:18.564899 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 525/973] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:36:18 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1730 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:36:18.565149 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-7a334635-16ee-4987-99d6-0b9b790127f9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:18.565149 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-7a334635-16ee-4987-99d6-0b9b790127f9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:18.569946 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7a334635-16ee-4987-99d6-0b9b790127f9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:18.570614 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7a334635-16ee-4987-99d6-0b9b790127f9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:18.571700 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7a334635-16ee-4987-99d6-0b9b790127f9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:18.572205 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7a334635-16ee-4987-99d6-0b9b790127f9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:18.642375 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.wsgi [None req-7a334635-16ee-4987-99d6-0b9b790127f9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] HTTP exception thrown: Instance aab2b795-8567-48fa-81d6-985a8f168f87 could not be found. May 03 21:36:18.643062 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-7a334635-16ee-4987-99d6-0b9b790127f9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Returning 404 to user: Instance aab2b795-8567-48fa-81d6-985a8f168f87 could not be found. {{(pid=97831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:36:18.644460 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-7a334635-16ee-4987-99d6-0b9b790127f9 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "DELETE /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87" status: 404 len: 111 microversion: 2.1 time: 0.102917 May 03 21:36:18.645337 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 449/974] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 3 21:36:18 2022] DELETE /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 21:36:18.659912 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-a9fdfc36-94ba-411d-94a7-e6572b775594 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:18.660689 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-a9fdfc36-94ba-411d-94a7-e6572b775594 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: aab2b795-8567-48fa-81d6-985a8f168f87] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:18.669203 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a9fdfc36-94ba-411d-94a7-e6572b775594 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:18.669649 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a9fdfc36-94ba-411d-94a7-e6572b775594 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:18.670432 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a9fdfc36-94ba-411d-94a7-e6572b775594 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:18.671018 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a9fdfc36-94ba-411d-94a7-e6572b775594 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:18.726092 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.wsgi [None req-a9fdfc36-94ba-411d-94a7-e6572b775594 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] HTTP exception thrown: Instance aab2b795-8567-48fa-81d6-985a8f168f87 could not be found. May 03 21:36:18.727138 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-a9fdfc36-94ba-411d-94a7-e6572b775594 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Returning 404 to user: Instance aab2b795-8567-48fa-81d6-985a8f168f87 could not be found. {{(pid=97832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:36:18.728661 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-a9fdfc36-94ba-411d-94a7-e6572b775594 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87" status: 404 len: 111 microversion: 2.1 time: 0.078760 May 03 21:36:18.729534 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 526/975] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:18 2022] GET /compute/v2.1/servers/aab2b795-8567-48fa-81d6-985a8f168f87 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 03 21:36:18.876211 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-0b653116-2e6d-4612-968d-c1b1484f1e28 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:18.877023 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-0b653116-2e6d-4612-968d-c1b1484f1e28 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: c8f9aa7c-153d-482a-b048-18cd034d21cb] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:18.885303 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0b653116-2e6d-4612-968d-c1b1484f1e28 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:18.886027 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0b653116-2e6d-4612-968d-c1b1484f1e28 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:18.887914 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0b653116-2e6d-4612-968d-c1b1484f1e28 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:18.893731 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0b653116-2e6d-4612-968d-c1b1484f1e28 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:19.109765 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-e15faf61-14b6-4a64-9bc4-3c1ef4eb181f tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-377999206", "imageRef": "f5214328-64f1-4aa6-aa05-61f0189e0e1e", "flavorRef": "452"}} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:36:19.183260 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.network.neutron [None req-e15faf61-14b6-4a64-9bc4-3c1ef4eb181f tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] validate_networks() for None {{(pid=97832) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} May 03 21:36:19.349264 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-0b653116-2e6d-4612-968d-c1b1484f1e28 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb/os-volume_attachments/f8930102-fbea-4916-8167-25cc3ea1bdd7" status: 202 len: 0 microversion: 2.1 time: 0.484367 May 03 21:36:19.351025 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 450/976] 10.222.0.48 () {58 vars in 1415 bytes} [Tue May 3 21:36:18 2022] DELETE /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb/os-volume_attachments/f8930102-fbea-4916-8167-25cc3ea1bdd7 => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 21:36:19.368599 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-72e5d4d4-fbe2-4712-8695-f91e3363ea2e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:19.370303 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-72e5d4d4-fbe2-4712-8695-f91e3363ea2e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: c8f9aa7c-153d-482a-b048-18cd034d21cb] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:19.379389 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-72e5d4d4-fbe2-4712-8695-f91e3363ea2e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:19.380150 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-72e5d4d4-fbe2-4712-8695-f91e3363ea2e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:19.381073 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-72e5d4d4-fbe2-4712-8695-f91e3363ea2e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:19.381509 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-72e5d4d4-fbe2-4712-8695-f91e3363ea2e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:19.460243 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-72e5d4d4-fbe2-4712-8695-f91e3363ea2e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103006 May 03 21:36:19.460645 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 451/977] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 3 21:36:19 2022] GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:36:19.591568 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-9119b219-757f-4fcd-acbc-9910865fccde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:19.594119 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-9119b219-757f-4fcd-acbc-9910865fccde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:19.606561 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9119b219-757f-4fcd-acbc-9910865fccde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:19.607644 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9119b219-757f-4fcd-acbc-9910865fccde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:19.608825 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9119b219-757f-4fcd-acbc-9910865fccde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:19.609628 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9119b219-757f-4fcd-acbc-9910865fccde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:19.636103 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-e15faf61-14b6-4a64-9bc4-3c1ef4eb181f tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Flavor limits 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} May 03 21:36:19.637133 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-e15faf61-14b6-4a64-9bc4-3c1ef4eb181f tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Image limits 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} May 03 21:36:19.637732 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-e15faf61-14b6-4a64-9bc4-3c1ef4eb181f tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Flavor pref 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} May 03 21:36:19.638220 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-e15faf61-14b6-4a64-9bc4-3c1ef4eb181f tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Image pref 0:0:0 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} May 03 21:36:19.638720 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.virt.hardware [None req-e15faf61-14b6-4a64-9bc4-3c1ef4eb181f tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} May 03 21:36:19.662344 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e15faf61-14b6-4a64-9bc4-3c1ef4eb181f tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:19.663974 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e15faf61-14b6-4a64-9bc4-3c1ef4eb181f tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:19.666282 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e15faf61-14b6-4a64-9bc4-3c1ef4eb181f tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:19.667042 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e15faf61-14b6-4a64-9bc4-3c1ef4eb181f tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:19.694758 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-e15faf61-14b6-4a64-9bc4-3c1ef4eb181f tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Getting quotas for project f7e2c28ff5bf44018ba1c85b0b7ebc46. Resources: {'instances', 'ram', 'cores'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:36:19.700637 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-e15faf61-14b6-4a64-9bc4-3c1ef4eb181f tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Getting quotas for user 054526572dda44aaa6421ae1a72824a4 and project f7e2c28ff5bf44018ba1c85b0b7ebc46. Resources: {'instances', 'ram', 'cores'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:36:19.722823 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-e15faf61-14b6-4a64-9bc4-3c1ef4eb181f tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Going to run 1 instances... {{(pid=97832) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} May 03 21:36:19.728029 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-e15faf61-14b6-4a64-9bc4-3c1ef4eb181f tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] [instance: 59c1d083-841e-41a3-a6a4-33d02ef688aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5214328-64f1-4aa6-aa05-61f0189e0e1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=97832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} May 03 21:36:19.864164 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-9119b219-757f-4fcd-acbc-9910865fccde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:19.882415 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-9119b219-757f-4fcd-acbc-9910865fccde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:19.890379 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-9119b219-757f-4fcd-acbc-9910865fccde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:19.891729 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-9119b219-757f-4fcd-acbc-9910865fccde tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1730 microversion: 2.20 time: 0.316829 May 03 21:36:19.892259 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 452/978] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:36:19 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1730 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 03 21:36:19.909581 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-e15faf61-14b6-4a64-9bc4-3c1ef4eb181f tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.810471 May 03 21:36:19.915372 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 527/979] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 3 21:36:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 03 21:36:19.932525 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-4a1789a7-69b5-4a83-baaa-fd09436c7b77 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:19.933026 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-4a1789a7-69b5-4a83-baaa-fd09436c7b77 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] [instance: 59c1d083-841e-41a3-a6a4-33d02ef688aa] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:20.017089 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-4a1789a7-69b5-4a83-baaa-fd09436c7b77 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054526572dda44aaa6421ae1a72824a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e2c28ff5bf44018ba1c85b0b7ebc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:20.025680 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-4a1789a7-69b5-4a83-baaa-fd09436c7b77 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] 10.222.0.48 "GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa" status: 200 len: 1214 microversion: 2.1 time: 0.105062 May 03 21:36:20.026299 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 453/980] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:19 2022] GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa => generated 1214 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:36:20.355798 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-bacdbab7-36be-4f26-bb4b-f40dc275cdbf tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:20.358517 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-bacdbab7-36be-4f26-bb4b-f40dc275cdbf tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:20.364873 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-bacdbab7-36be-4f26-bb4b-f40dc275cdbf tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:20.365607 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-bacdbab7-36be-4f26-bb4b-f40dc275cdbf tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:20.366403 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-bacdbab7-36be-4f26-bb4b-f40dc275cdbf tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:20.366844 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-bacdbab7-36be-4f26-bb4b-f40dc275cdbf tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:20.423591 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.wsgi [None req-bacdbab7-36be-4f26-bb4b-f40dc275cdbf tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] HTTP exception thrown: Instance 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a could not be found. May 03 21:36:20.424534 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-bacdbab7-36be-4f26-bb4b-f40dc275cdbf tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Returning 404 to user: Instance 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a could not be found. {{(pid=97832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:36:20.425384 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-bacdbab7-36be-4f26-bb4b-f40dc275cdbf tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "DELETE /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 404 len: 111 microversion: 2.1 time: 0.079211 May 03 21:36:20.425946 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 528/981] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 3 21:36:20 2022] DELETE /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 21:36:20.439666 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-d98f92cd-2e87-466b-a787-28165c942f32 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:20.440619 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-d98f92cd-2e87-466b-a787-28165c942f32 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] [instance: 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:20.450917 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d98f92cd-2e87-466b-a787-28165c942f32 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:20.450917 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d98f92cd-2e87-466b-a787-28165c942f32 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:20.450917 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d98f92cd-2e87-466b-a787-28165c942f32 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:20.450917 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d98f92cd-2e87-466b-a787-28165c942f32 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:20.479407 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-b7ceae4c-8928-41e3-ae0b-c14da6c9bf2c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:20.481887 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-b7ceae4c-8928-41e3-ae0b-c14da6c9bf2c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: c8f9aa7c-153d-482a-b048-18cd034d21cb] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:20.490105 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b7ceae4c-8928-41e3-ae0b-c14da6c9bf2c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:20.490720 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b7ceae4c-8928-41e3-ae0b-c14da6c9bf2c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:20.491626 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b7ceae4c-8928-41e3-ae0b-c14da6c9bf2c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:20.493136 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b7ceae4c-8928-41e3-ae0b-c14da6c9bf2c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:20.534303 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.wsgi [None req-d98f92cd-2e87-466b-a787-28165c942f32 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] HTTP exception thrown: Instance 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a could not be found. May 03 21:36:20.534923 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-d98f92cd-2e87-466b-a787-28165c942f32 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] Returning 404 to user: Instance 274fd6f3-1f2e-4da8-8c5f-fa173514fc2a could not be found. {{(pid=97831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:36:20.536529 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-d98f92cd-2e87-466b-a787-28165c942f32 tempest-AttachVolumeTestJSON-2138757921 tempest-AttachVolumeTestJSON-2138757921-project] 10.222.0.48 "GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a" status: 404 len: 111 microversion: 2.1 time: 0.106122 May 03 21:36:20.537245 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 454/982] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:20 2022] GET /compute/v2.1/servers/274fd6f3-1f2e-4da8-8c5f-fa173514fc2a => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 21:36:20.586829 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-b7ceae4c-8928-41e3-ae0b-c14da6c9bf2c tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117300 May 03 21:36:20.587563 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 529/983] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 3 21:36:20 2022] GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:36:20.917257 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-c21a0afb-70d9-4012-a031-4a262991a7ef tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:20.919015 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-c21a0afb-70d9-4012-a031-4a262991a7ef tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:20.929701 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c21a0afb-70d9-4012-a031-4a262991a7ef tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:20.930156 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c21a0afb-70d9-4012-a031-4a262991a7ef tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:20.930915 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c21a0afb-70d9-4012-a031-4a262991a7ef tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:20.931345 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-c21a0afb-70d9-4012-a031-4a262991a7ef tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:21.055205 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-6861f194-cc44-4968-9803-7f2709ac4ca4 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:21.056166 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-6861f194-cc44-4968-9803-7f2709ac4ca4 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] [instance: 59c1d083-841e-41a3-a6a4-33d02ef688aa] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:21.185257 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-6861f194-cc44-4968-9803-7f2709ac4ca4 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054526572dda44aaa6421ae1a72824a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e2c28ff5bf44018ba1c85b0b7ebc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:21.194095 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-6861f194-cc44-4968-9803-7f2709ac4ca4 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] 10.222.0.48 "GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa" status: 200 len: 1214 microversion: 2.1 time: 0.153952 May 03 21:36:21.195280 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 530/984] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:21 2022] GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa => generated 1214 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:36:21.412160 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-c21a0afb-70d9-4012-a031-4a262991a7ef tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:21.426348 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-c21a0afb-70d9-4012-a031-4a262991a7ef tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:21.432746 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-c21a0afb-70d9-4012-a031-4a262991a7ef tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:21.434586 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-c21a0afb-70d9-4012-a031-4a262991a7ef tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1730 microversion: 2.20 time: 0.527464 May 03 21:36:21.435121 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 455/985] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:36:20 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1730 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:36:21.604724 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-ec2cd78c-28e8-4ea7-b306-c187ad5f8038 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:21.606238 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-ec2cd78c-28e8-4ea7-b306-c187ad5f8038 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: c8f9aa7c-153d-482a-b048-18cd034d21cb] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:21.621705 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ec2cd78c-28e8-4ea7-b306-c187ad5f8038 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:21.622606 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ec2cd78c-28e8-4ea7-b306-c187ad5f8038 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:21.624002 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ec2cd78c-28e8-4ea7-b306-c187ad5f8038 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:21.624815 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ec2cd78c-28e8-4ea7-b306-c187ad5f8038 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:21.702127 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-ec2cd78c-28e8-4ea7-b306-c187ad5f8038 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106618 May 03 21:36:21.702746 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 531/986] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 3 21:36:21 2022] GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb/os-volume_attachments => generated 25 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 03 21:36:21.801016 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-ba68e5fe-a692-41a3-9ee0-5f45e7af7302 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:21.801668 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-ba68e5fe-a692-41a3-9ee0-5f45e7af7302 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: c8f9aa7c-153d-482a-b048-18cd034d21cb] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:21.810589 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ba68e5fe-a692-41a3-9ee0-5f45e7af7302 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:21.811198 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ba68e5fe-a692-41a3-9ee0-5f45e7af7302 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:21.812090 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ba68e5fe-a692-41a3-9ee0-5f45e7af7302 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:21.812651 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ba68e5fe-a692-41a3-9ee0-5f45e7af7302 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:21.889561 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-ba68e5fe-a692-41a3-9ee0-5f45e7af7302 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: c8f9aa7c-153d-482a-b048-18cd034d21cb] Going to try to terminate instance {{(pid=97831) delete /opt/stack/nova/nova/compute/api.py:2559}} May 03 21:36:22.199967 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-ba68e5fe-a692-41a3-9ee0-5f45e7af7302 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb" status: 204 len: 0 microversion: 2.1 time: 0.409093 May 03 21:36:22.200952 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 456/987] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 3 21:36:21 2022] DELETE /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 03 21:36:22.215483 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-8ea455b7-3180-4dbf-9ead-8bd29b3fb24a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:22.216878 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-8ea455b7-3180-4dbf-9ead-8bd29b3fb24a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: c8f9aa7c-153d-482a-b048-18cd034d21cb] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:22.224569 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8ea455b7-3180-4dbf-9ead-8bd29b3fb24a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:22.225006 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-44a2a87d-3212-473e-b4b0-3e005c8aa7db tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:22.225123 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8ea455b7-3180-4dbf-9ead-8bd29b3fb24a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:22.226035 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-44a2a87d-3212-473e-b4b0-3e005c8aa7db tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] [instance: 59c1d083-841e-41a3-a6a4-33d02ef688aa] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:22.226195 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8ea455b7-3180-4dbf-9ead-8bd29b3fb24a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:22.226818 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8ea455b7-3180-4dbf-9ead-8bd29b3fb24a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:22.234671 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-44a2a87d-3212-473e-b4b0-3e005c8aa7db tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:22.235267 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-44a2a87d-3212-473e-b4b0-3e005c8aa7db tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:22.240262 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-44a2a87d-3212-473e-b4b0-3e005c8aa7db tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:22.240262 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-44a2a87d-3212-473e-b4b0-3e005c8aa7db tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:22.422468 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-44a2a87d-3212-473e-b4b0-3e005c8aa7db tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054526572dda44aaa6421ae1a72824a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e2c28ff5bf44018ba1c85b0b7ebc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:22.449417 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-44a2a87d-3212-473e-b4b0-3e005c8aa7db tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] 10.222.0.48 "GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa" status: 200 len: 1266 microversion: 2.1 time: 0.233509 May 03 21:36:22.459321 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-8ea455b7-3180-4dbf-9ead-8bd29b3fb24a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:22.459669 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 457/988] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:22 2022] GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:36:22.462634 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-8ea455b7-3180-4dbf-9ead-8bd29b3fb24a tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb" status: 200 len: 1680 microversion: 2.1 time: 0.257429 May 03 21:36:22.472606 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 532/989] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:22 2022] GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb => generated 1680 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:36:22.476882 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-e27b4ba7-a23c-4b7d-9418-68abcec0cf6a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:22.477862 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-e27b4ba7-a23c-4b7d-9418-68abcec0cf6a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:22.493664 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e27b4ba7-a23c-4b7d-9418-68abcec0cf6a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:22.494999 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e27b4ba7-a23c-4b7d-9418-68abcec0cf6a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:22.496479 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e27b4ba7-a23c-4b7d-9418-68abcec0cf6a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:22.496913 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e27b4ba7-a23c-4b7d-9418-68abcec0cf6a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:22.614135 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-64c20c37-3153-4ee1-b78c-7b0754c364d8 req-2762b3d6-1f6e-49c3-a4fb-a70f164260b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49b86a80-657d-4e94-bc71-bcfe8f276469", "name": "network-vif-plugged", "status": "completed", "tag": "4a088512-8058-4a9a-a45b-177671d97cfc"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:36:22.622529 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:36:22.622529 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:36:22.631501 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-64c20c37-3153-4ee1-b78c-7b0754c364d8 req-2762b3d6-1f6e-49c3-a4fb-a70f164260b5 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:22.632672 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-64c20c37-3153-4ee1-b78c-7b0754c364d8 req-2762b3d6-1f6e-49c3-a4fb-a70f164260b5 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:22.649423 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-64c20c37-3153-4ee1-b78c-7b0754c364d8 req-2762b3d6-1f6e-49c3-a4fb-a70f164260b5 service nova] Creating event network-vif-plugged:4a088512-8058-4a9a-a45b-177671d97cfc for instance 49b86a80-657d-4e94-bc71-bcfe8f276469 on hv-cinder-84037 May 03 21:36:22.655092 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-64c20c37-3153-4ee1-b78c-7b0754c364d8 req-2762b3d6-1f6e-49c3-a4fb-a70f164260b5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053109 May 03 21:36:22.655653 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 533/990] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:36:23.306675 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-e27b4ba7-a23c-4b7d-9418-68abcec0cf6a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:23.320789 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-e27b4ba7-a23c-4b7d-9418-68abcec0cf6a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:23.327828 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-e27b4ba7-a23c-4b7d-9418-68abcec0cf6a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:23.329108 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-e27b4ba7-a23c-4b7d-9418-68abcec0cf6a tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1730 microversion: 2.20 time: 0.873984 May 03 21:36:23.329646 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 458/991] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:36:22 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1730 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:36:23.476245 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-9e426b87-c957-49d8-8ad3-0beea967c274 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:23.476245 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-9e426b87-c957-49d8-8ad3-0beea967c274 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] [instance: 59c1d083-841e-41a3-a6a4-33d02ef688aa] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:23.492114 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9e426b87-c957-49d8-8ad3-0beea967c274 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:23.492609 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9e426b87-c957-49d8-8ad3-0beea967c274 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:23.493400 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9e426b87-c957-49d8-8ad3-0beea967c274 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:23.493832 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9e426b87-c957-49d8-8ad3-0beea967c274 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:23.497438 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-7c60c5d9-45d7-441f-9e46-68bf75106839 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:23.498063 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-7c60c5d9-45d7-441f-9e46-68bf75106839 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: c8f9aa7c-153d-482a-b048-18cd034d21cb] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:23.508579 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7c60c5d9-45d7-441f-9e46-68bf75106839 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:23.508956 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7c60c5d9-45d7-441f-9e46-68bf75106839 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:23.509914 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7c60c5d9-45d7-441f-9e46-68bf75106839 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:23.510992 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7c60c5d9-45d7-441f-9e46-68bf75106839 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:23.681752 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-9e426b87-c957-49d8-8ad3-0beea967c274 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054526572dda44aaa6421ae1a72824a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e2c28ff5bf44018ba1c85b0b7ebc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:23.693709 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-9e426b87-c957-49d8-8ad3-0beea967c274 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] 10.222.0.48 "GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa" status: 200 len: 1272 microversion: 2.1 time: 0.230039 May 03 21:36:23.698176 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 534/992] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:23 2022] GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa => generated 1272 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:36:24.000251 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-7c60c5d9-45d7-441f-9e46-68bf75106839 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:24.009322 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-7c60c5d9-45d7-441f-9e46-68bf75106839 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb" status: 200 len: 1680 microversion: 2.1 time: 0.527141 May 03 21:36:24.009908 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 459/993] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:23 2022] GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb => generated 1680 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:36:24.352724 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-e901d1a0-0dca-4344-b017-723cf8762320 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:24.353256 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-e901d1a0-0dca-4344-b017-723cf8762320 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:24.361570 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e901d1a0-0dca-4344-b017-723cf8762320 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:24.364994 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e901d1a0-0dca-4344-b017-723cf8762320 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:24.364994 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e901d1a0-0dca-4344-b017-723cf8762320 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:24.364994 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e901d1a0-0dca-4344-b017-723cf8762320 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:24.605579 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-e901d1a0-0dca-4344-b017-723cf8762320 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:24.619464 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-e901d1a0-0dca-4344-b017-723cf8762320 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:24.626065 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-e901d1a0-0dca-4344-b017-723cf8762320 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:24.627166 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-e901d1a0-0dca-4344-b017-723cf8762320 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1730 microversion: 2.20 time: 0.283961 May 03 21:36:24.627684 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 535/994] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:36:24 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1730 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:36:24.721270 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-9bb6ff49-336a-49f9-9917-8f70a954545c tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:24.722410 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-9bb6ff49-336a-49f9-9917-8f70a954545c tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] [instance: 59c1d083-841e-41a3-a6a4-33d02ef688aa] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:24.730804 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9bb6ff49-336a-49f9-9917-8f70a954545c tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:24.731564 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9bb6ff49-336a-49f9-9917-8f70a954545c tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:24.732550 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9bb6ff49-336a-49f9-9917-8f70a954545c tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:24.733127 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9bb6ff49-336a-49f9-9917-8f70a954545c tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:24.996000 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-9bb6ff49-336a-49f9-9917-8f70a954545c tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054526572dda44aaa6421ae1a72824a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e2c28ff5bf44018ba1c85b0b7ebc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:25.025281 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-9bb6ff49-336a-49f9-9917-8f70a954545c tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] 10.222.0.48 "GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa" status: 200 len: 1272 microversion: 2.1 time: 0.316763 May 03 21:36:25.039226 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 460/995] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:24 2022] GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa => generated 1272 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:36:25.039453 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-46c4fb64-6455-4ab1-b102-0ca0cf24ef5f tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:25.040142 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-46c4fb64-6455-4ab1-b102-0ca0cf24ef5f tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: c8f9aa7c-153d-482a-b048-18cd034d21cb] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:25.051450 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-46c4fb64-6455-4ab1-b102-0ca0cf24ef5f tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:25.052083 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-46c4fb64-6455-4ab1-b102-0ca0cf24ef5f tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:25.053072 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-46c4fb64-6455-4ab1-b102-0ca0cf24ef5f tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:25.053613 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-46c4fb64-6455-4ab1-b102-0ca0cf24ef5f tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:25.323161 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-46c4fb64-6455-4ab1-b102-0ca0cf24ef5f tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:25.333595 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-46c4fb64-6455-4ab1-b102-0ca0cf24ef5f tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb" status: 200 len: 1680 microversion: 2.1 time: 0.308717 May 03 21:36:25.334289 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 536/996] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:25 2022] GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb => generated 1680 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:36:25.653882 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-7a365adf-f5a0-4e9d-811a-48841321169f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:25.654196 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-7a365adf-f5a0-4e9d-811a-48841321169f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:25.662079 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7a365adf-f5a0-4e9d-811a-48841321169f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:25.662984 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7a365adf-f5a0-4e9d-811a-48841321169f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:25.663370 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7a365adf-f5a0-4e9d-811a-48841321169f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:25.663806 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7a365adf-f5a0-4e9d-811a-48841321169f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:26.053921 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-8ddf91fc-b8ea-44e0-a9e7-8fdc94753bb4 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:26.055912 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-8ddf91fc-b8ea-44e0-a9e7-8fdc94753bb4 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] [instance: 59c1d083-841e-41a3-a6a4-33d02ef688aa] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:26.066251 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8ddf91fc-b8ea-44e0-a9e7-8fdc94753bb4 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:26.074879 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8ddf91fc-b8ea-44e0-a9e7-8fdc94753bb4 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:26.074879 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8ddf91fc-b8ea-44e0-a9e7-8fdc94753bb4 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:26.074879 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8ddf91fc-b8ea-44e0-a9e7-8fdc94753bb4 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:26.351557 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-8ddf91fc-b8ea-44e0-a9e7-8fdc94753bb4 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054526572dda44aaa6421ae1a72824a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e2c28ff5bf44018ba1c85b0b7ebc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:26.360933 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-8ddf91fc-b8ea-44e0-a9e7-8fdc94753bb4 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] 10.222.0.48 "GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa" status: 200 len: 1314 microversion: 2.1 time: 0.316622 May 03 21:36:26.368733 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 537/997] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:26 2022] GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:36:26.383065 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-186c37fe-c2db-492b-9f59-0c6d6f0d14aa tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:26.384340 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-186c37fe-c2db-492b-9f59-0c6d6f0d14aa tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: c8f9aa7c-153d-482a-b048-18cd034d21cb] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:26.396260 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-186c37fe-c2db-492b-9f59-0c6d6f0d14aa tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:26.396741 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-186c37fe-c2db-492b-9f59-0c6d6f0d14aa tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:26.397590 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-186c37fe-c2db-492b-9f59-0c6d6f0d14aa tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:26.398028 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-186c37fe-c2db-492b-9f59-0c6d6f0d14aa tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:26.655543 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-186c37fe-c2db-492b-9f59-0c6d6f0d14aa tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:26.663836 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-186c37fe-c2db-492b-9f59-0c6d6f0d14aa tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb" status: 200 len: 1680 microversion: 2.1 time: 0.299082 May 03 21:36:26.664701 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 538/998] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:26 2022] GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb => generated 1680 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:36:26.990500 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-7a365adf-f5a0-4e9d-811a-48841321169f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:27.018496 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-7a365adf-f5a0-4e9d-811a-48841321169f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:27.033016 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-7a365adf-f5a0-4e9d-811a-48841321169f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:27.035077 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-7a365adf-f5a0-4e9d-811a-48841321169f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1730 microversion: 2.20 time: 1.391416 May 03 21:36:27.036023 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 461/999] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:36:25 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1730 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:36:27.385505 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-0de49747-2d2f-4953-88b6-667ba80b7a75 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:27.387800 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-0de49747-2d2f-4953-88b6-667ba80b7a75 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] [instance: 59c1d083-841e-41a3-a6a4-33d02ef688aa] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:27.395490 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0de49747-2d2f-4953-88b6-667ba80b7a75 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:27.395940 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0de49747-2d2f-4953-88b6-667ba80b7a75 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:27.396810 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0de49747-2d2f-4953-88b6-667ba80b7a75 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:27.397235 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0de49747-2d2f-4953-88b6-667ba80b7a75 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:27.624162 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-0de49747-2d2f-4953-88b6-667ba80b7a75 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054526572dda44aaa6421ae1a72824a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e2c28ff5bf44018ba1c85b0b7ebc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:27.632989 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-0de49747-2d2f-4953-88b6-667ba80b7a75 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] 10.222.0.48 "GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa" status: 200 len: 1314 microversion: 2.1 time: 0.256725 May 03 21:36:27.633533 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 539/1000] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:27 2022] GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:36:27.687837 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-900a1f47-f08f-40b4-830c-cf3b7f8c9f29 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:27.688365 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-900a1f47-f08f-40b4-830c-cf3b7f8c9f29 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: c8f9aa7c-153d-482a-b048-18cd034d21cb] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:27.695882 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-900a1f47-f08f-40b4-830c-cf3b7f8c9f29 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:27.696837 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-900a1f47-f08f-40b4-830c-cf3b7f8c9f29 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:27.697160 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-900a1f47-f08f-40b4-830c-cf3b7f8c9f29 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:27.697598 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-900a1f47-f08f-40b4-830c-cf3b7f8c9f29 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:27.952556 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-900a1f47-f08f-40b4-830c-cf3b7f8c9f29 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:27.961682 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-900a1f47-f08f-40b4-830c-cf3b7f8c9f29 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb" status: 200 len: 1613 microversion: 2.1 time: 0.283833 May 03 21:36:27.962577 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 462/1001] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:27 2022] GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb => generated 1613 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:36:28.067194 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-9837b22a-a4c9-4f29-888c-f9cab0aa0cfb tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:28.068028 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-9837b22a-a4c9-4f29-888c-f9cab0aa0cfb tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:28.077640 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9837b22a-a4c9-4f29-888c-f9cab0aa0cfb tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:28.078434 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9837b22a-a4c9-4f29-888c-f9cab0aa0cfb tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:28.079651 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9837b22a-a4c9-4f29-888c-f9cab0aa0cfb tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:28.080296 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9837b22a-a4c9-4f29-888c-f9cab0aa0cfb tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:28.326059 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-9837b22a-a4c9-4f29-888c-f9cab0aa0cfb tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:28.340704 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-9837b22a-a4c9-4f29-888c-f9cab0aa0cfb tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:28.347150 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-9837b22a-a4c9-4f29-888c-f9cab0aa0cfb tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:28.348328 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-9837b22a-a4c9-4f29-888c-f9cab0aa0cfb tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1717 microversion: 2.20 time: 0.291867 May 03 21:36:28.349134 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 540/1002] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:36:28 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1717 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:36:28.659352 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-e5c91b5d-23c7-412b-b16b-4263112dd79e tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:28.659973 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-e5c91b5d-23c7-412b-b16b-4263112dd79e tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] [instance: 59c1d083-841e-41a3-a6a4-33d02ef688aa] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:28.669684 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e5c91b5d-23c7-412b-b16b-4263112dd79e tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:28.670278 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e5c91b5d-23c7-412b-b16b-4263112dd79e tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:28.671318 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e5c91b5d-23c7-412b-b16b-4263112dd79e tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:28.671874 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e5c91b5d-23c7-412b-b16b-4263112dd79e tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:28.986655 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-56e4c018-5699-4a9d-8364-6c05347244a1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:28.991952 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-56e4c018-5699-4a9d-8364-6c05347244a1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: c8f9aa7c-153d-482a-b048-18cd034d21cb] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:29.004654 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-56e4c018-5699-4a9d-8364-6c05347244a1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:29.005543 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-56e4c018-5699-4a9d-8364-6c05347244a1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:29.006741 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-56e4c018-5699-4a9d-8364-6c05347244a1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:29.007471 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-56e4c018-5699-4a9d-8364-6c05347244a1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:29.277832 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-56e4c018-5699-4a9d-8364-6c05347244a1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:29.297420 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-56e4c018-5699-4a9d-8364-6c05347244a1 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb" status: 200 len: 1613 microversion: 2.1 time: 0.320980 May 03 21:36:29.310436 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 541/1003] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:28 2022] GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb => generated 1613 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:36:29.741580 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-e2988fe6-1fc4-4ab2-9c0d-e8ca22df3666 req-0c75d538-a3a8-4665-8da1-81ec2742e79c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8f9aa7c-153d-482a-b048-18cd034d21cb", "name": "network-vif-deleted", "tag": "479a7085-462d-430f-b37d-544e02378d26"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:36:29.766722 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:36:29.766722 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:36:29.778845 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-e2988fe6-1fc4-4ab2-9c0d-e8ca22df3666 req-0c75d538-a3a8-4665-8da1-81ec2742e79c service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:29.784969 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-e2988fe6-1fc4-4ab2-9c0d-e8ca22df3666 req-0c75d538-a3a8-4665-8da1-81ec2742e79c service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:29.831360 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-e2988fe6-1fc4-4ab2-9c0d-e8ca22df3666 req-0c75d538-a3a8-4665-8da1-81ec2742e79c service nova] Creating event network-vif-deleted:479a7085-462d-430f-b37d-544e02378d26 for instance c8f9aa7c-153d-482a-b048-18cd034d21cb on hv-cinder-84037 May 03 21:36:29.850880 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-e2988fe6-1fc4-4ab2-9c0d-e8ca22df3666 req-0c75d538-a3a8-4665-8da1-81ec2742e79c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133306 May 03 21:36:29.851994 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 542/1004] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:36:29.906317 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-e5c91b5d-23c7-412b-b16b-4263112dd79e tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054526572dda44aaa6421ae1a72824a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e2c28ff5bf44018ba1c85b0b7ebc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:29.934201 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-e5c91b5d-23c7-412b-b16b-4263112dd79e tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] 10.222.0.48 "GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa" status: 200 len: 1314 microversion: 2.1 time: 1.283179 May 03 21:36:29.944499 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 463/1005] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:28 2022] GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa => generated 1314 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:36:30.335508 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-44d61473-c2df-45fd-b06a-2cfe149ec0c4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:30.337677 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-44d61473-c2df-45fd-b06a-2cfe149ec0c4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: c8f9aa7c-153d-482a-b048-18cd034d21cb] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:30.352887 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-44d61473-c2df-45fd-b06a-2cfe149ec0c4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:30.354717 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-44d61473-c2df-45fd-b06a-2cfe149ec0c4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:30.356346 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-44d61473-c2df-45fd-b06a-2cfe149ec0c4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:30.357219 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-44d61473-c2df-45fd-b06a-2cfe149ec0c4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:30.454385 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-44d61473-c2df-45fd-b06a-2cfe149ec0c4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:30.455000 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-44d61473-c2df-45fd-b06a-2cfe149ec0c4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:30.456260 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.objects.instance [None req-44d61473-c2df-45fd-b06a-2cfe149ec0c4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lazy-loading 'fault' on Instance uuid c8f9aa7c-153d-482a-b048-18cd034d21cb {{(pid=97832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 03 21:36:30.597836 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-44d61473-c2df-45fd-b06a-2cfe149ec0c4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2fe2da4d72e4522ac8bbb7c9a58381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd571e41b44a4bc6b16bf8163252f168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:30.609571 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-44d61473-c2df-45fd-b06a-2cfe149ec0c4 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb" status: 200 len: 1331 microversion: 2.1 time: 0.294807 May 03 21:36:30.610847 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 543/1006] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:30 2022] GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb => generated 1331 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:36:30.968209 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-253e05ec-1fcd-49bb-a70b-d924441d7cbe tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:30.969627 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-253e05ec-1fcd-49bb-a70b-d924441d7cbe tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] [instance: 59c1d083-841e-41a3-a6a4-33d02ef688aa] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:30.977657 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-253e05ec-1fcd-49bb-a70b-d924441d7cbe tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:30.978421 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-253e05ec-1fcd-49bb-a70b-d924441d7cbe tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:30.979451 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-253e05ec-1fcd-49bb-a70b-d924441d7cbe tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:30.980401 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-253e05ec-1fcd-49bb-a70b-d924441d7cbe tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:31.232737 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-253e05ec-1fcd-49bb-a70b-d924441d7cbe tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054526572dda44aaa6421ae1a72824a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e2c28ff5bf44018ba1c85b0b7ebc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:31.241654 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-253e05ec-1fcd-49bb-a70b-d924441d7cbe tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] 10.222.0.48 "GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa" status: 200 len: 1314 microversion: 2.1 time: 0.282712 May 03 21:36:31.242497 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 464/1007] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:30 2022] GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:36:31.633236 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-3c26b78e-f61d-482c-9f1c-628001462494 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:31.633937 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-3c26b78e-f61d-482c-9f1c-628001462494 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: c8f9aa7c-153d-482a-b048-18cd034d21cb] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:31.642889 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3c26b78e-f61d-482c-9f1c-628001462494 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:31.643451 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3c26b78e-f61d-482c-9f1c-628001462494 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:31.644232 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3c26b78e-f61d-482c-9f1c-628001462494 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:31.644763 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3c26b78e-f61d-482c-9f1c-628001462494 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:31.701640 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.wsgi [None req-3c26b78e-f61d-482c-9f1c-628001462494 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] HTTP exception thrown: Instance c8f9aa7c-153d-482a-b048-18cd034d21cb could not be found. May 03 21:36:31.702244 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-3c26b78e-f61d-482c-9f1c-628001462494 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Returning 404 to user: Instance c8f9aa7c-153d-482a-b048-18cd034d21cb could not be found. {{(pid=97832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:36:31.703079 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-3c26b78e-f61d-482c-9f1c-628001462494 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb" status: 404 len: 111 microversion: 2.1 time: 0.079560 May 03 21:36:31.703998 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 544/1008] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:31 2022] GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 21:36:31.717767 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-6a6b0453-2ed7-4114-bc0c-07fe7d1bb671 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '.version_select at 0x7fc84cc42790>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:31.832755 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-6a6b0453-2ed7-4114-bc0c-07fe7d1bb671 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1472811381" status: 202 len: 0 microversion: 2.1 time: 0.116076 May 03 21:36:31.834187 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 465/1009] 10.222.0.48 () {58 vars in 1220 bytes} [Tue May 3 21:36:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1472811381 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 03 21:36:31.874620 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-39f56fe7-981c-4329-aafe-c8505ede53f2 req-3c5021d1-0260-481f-96c6-e3599b801260 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59c1d083-841e-41a3-a6a4-33d02ef688aa", "tag": "056ed7bb-a24e-42bf-8812-f1984a9af040"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:36:31.881031 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:36:31.881031 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:36:31.889290 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-39f56fe7-981c-4329-aafe-c8505ede53f2 req-3c5021d1-0260-481f-96c6-e3599b801260 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:31.889822 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-39f56fe7-981c-4329-aafe-c8505ede53f2 req-3c5021d1-0260-481f-96c6-e3599b801260 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:31.906742 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-39f56fe7-981c-4329-aafe-c8505ede53f2 req-3c5021d1-0260-481f-96c6-e3599b801260 service nova] Creating event network-changed:056ed7bb-a24e-42bf-8812-f1984a9af040 for instance 59c1d083-841e-41a3-a6a4-33d02ef688aa on hv-cinder-84037 May 03 21:36:31.911434 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-39f56fe7-981c-4329-aafe-c8505ede53f2 req-3c5021d1-0260-481f-96c6-e3599b801260 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046059 May 03 21:36:31.912581 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 545/1010] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:36:32.271019 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-38f458c1-0b37-421b-8c23-17210f31a35d tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:32.272290 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-38f458c1-0b37-421b-8c23-17210f31a35d tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] [instance: 59c1d083-841e-41a3-a6a4-33d02ef688aa] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:32.283731 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-38f458c1-0b37-421b-8c23-17210f31a35d tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:32.284919 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-38f458c1-0b37-421b-8c23-17210f31a35d tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:32.286548 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-38f458c1-0b37-421b-8c23-17210f31a35d tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:32.287518 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-38f458c1-0b37-421b-8c23-17210f31a35d tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:33.037189 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-38f458c1-0b37-421b-8c23-17210f31a35d tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054526572dda44aaa6421ae1a72824a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e2c28ff5bf44018ba1c85b0b7ebc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:33.063498 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-38f458c1-0b37-421b-8c23-17210f31a35d tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] 10.222.0.48 "GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa" status: 200 len: 1314 microversion: 2.1 time: 0.807551 May 03 21:36:33.064780 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 466/1011] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:32 2022] GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa => generated 1314 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:36:34.092169 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-31a79304-770d-4fee-9b1b-1db21645d406 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:34.094430 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-31a79304-770d-4fee-9b1b-1db21645d406 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] [instance: 59c1d083-841e-41a3-a6a4-33d02ef688aa] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:34.125100 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-31a79304-770d-4fee-9b1b-1db21645d406 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:34.129812 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-31a79304-770d-4fee-9b1b-1db21645d406 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:34.129812 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-31a79304-770d-4fee-9b1b-1db21645d406 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:34.129812 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-31a79304-770d-4fee-9b1b-1db21645d406 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:34.381256 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-31a79304-770d-4fee-9b1b-1db21645d406 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054526572dda44aaa6421ae1a72824a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e2c28ff5bf44018ba1c85b0b7ebc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:34.389827 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-31a79304-770d-4fee-9b1b-1db21645d406 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] 10.222.0.48 "GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa" status: 200 len: 1314 microversion: 2.1 time: 0.312332 May 03 21:36:34.390455 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 546/1012] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:34 2022] GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:36:34.728675 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-d4b7c90a-9297-47fe-b237-3442a1c6b031 req-afb8a080-8033-4ca9-8869-7d136ad0c3d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59c1d083-841e-41a3-a6a4-33d02ef688aa", "name": "network-vif-plugged", "status": "completed", "tag": "056ed7bb-a24e-42bf-8812-f1984a9af040"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:36:34.735734 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:36:34.735734 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:36:34.743976 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-d4b7c90a-9297-47fe-b237-3442a1c6b031 req-afb8a080-8033-4ca9-8869-7d136ad0c3d2 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:34.744418 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-d4b7c90a-9297-47fe-b237-3442a1c6b031 req-afb8a080-8033-4ca9-8869-7d136ad0c3d2 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:34.765258 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-d4b7c90a-9297-47fe-b237-3442a1c6b031 req-afb8a080-8033-4ca9-8869-7d136ad0c3d2 service nova] Creating event network-vif-plugged:056ed7bb-a24e-42bf-8812-f1984a9af040 for instance 59c1d083-841e-41a3-a6a4-33d02ef688aa on hv-cinder-84037 May 03 21:36:34.770288 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-d4b7c90a-9297-47fe-b237-3442a1c6b031 req-afb8a080-8033-4ca9-8869-7d136ad0c3d2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051295 May 03 21:36:34.771129 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 467/1013] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:36:35.283845 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-0c511e9e-f240-474c-afb5-d565e1ab9a7f tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:35.284450 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-0c511e9e-f240-474c-afb5-d565e1ab9a7f tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: c8f9aa7c-153d-482a-b048-18cd034d21cb] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:35.292229 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0c511e9e-f240-474c-afb5-d565e1ab9a7f tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:35.292797 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0c511e9e-f240-474c-afb5-d565e1ab9a7f tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:35.293731 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0c511e9e-f240-474c-afb5-d565e1ab9a7f tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:35.294158 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0c511e9e-f240-474c-afb5-d565e1ab9a7f tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:35.345112 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.wsgi [None req-0c511e9e-f240-474c-afb5-d565e1ab9a7f tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] HTTP exception thrown: Instance c8f9aa7c-153d-482a-b048-18cd034d21cb could not be found. May 03 21:36:35.345730 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-0c511e9e-f240-474c-afb5-d565e1ab9a7f tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Returning 404 to user: Instance c8f9aa7c-153d-482a-b048-18cd034d21cb could not be found. {{(pid=97832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:36:35.346569 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-0c511e9e-f240-474c-afb5-d565e1ab9a7f tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb" status: 404 len: 111 microversion: 2.1 time: 0.072633 May 03 21:36:35.347170 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 547/1014] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 3 21:36:35 2022] DELETE /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 21:36:35.361990 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-11bfec06-984e-42ab-bd44-e240a8c58413 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:35.362704 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-11bfec06-984e-42ab-bd44-e240a8c58413 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: c8f9aa7c-153d-482a-b048-18cd034d21cb] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:35.371743 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-11bfec06-984e-42ab-bd44-e240a8c58413 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:35.372198 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-11bfec06-984e-42ab-bd44-e240a8c58413 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:35.373031 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-11bfec06-984e-42ab-bd44-e240a8c58413 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:35.373472 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-11bfec06-984e-42ab-bd44-e240a8c58413 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:35.414094 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-236ae3fc-7ebe-4b44-9426-ea123ed95a98 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:35.414728 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-236ae3fc-7ebe-4b44-9426-ea123ed95a98 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] [instance: 59c1d083-841e-41a3-a6a4-33d02ef688aa] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:35.424702 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-236ae3fc-7ebe-4b44-9426-ea123ed95a98 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:35.429152 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-236ae3fc-7ebe-4b44-9426-ea123ed95a98 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:35.429290 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.wsgi [None req-11bfec06-984e-42ab-bd44-e240a8c58413 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] HTTP exception thrown: Instance c8f9aa7c-153d-482a-b048-18cd034d21cb could not be found. May 03 21:36:35.429438 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-236ae3fc-7ebe-4b44-9426-ea123ed95a98 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:35.429523 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-11bfec06-984e-42ab-bd44-e240a8c58413 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Returning 404 to user: Instance c8f9aa7c-153d-482a-b048-18cd034d21cb could not be found. {{(pid=97831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:36:35.429601 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-236ae3fc-7ebe-4b44-9426-ea123ed95a98 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:35.429777 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-11bfec06-984e-42ab-bd44-e240a8c58413 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb" status: 404 len: 111 microversion: 2.1 time: 0.075692 May 03 21:36:35.431547 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 468/1015] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:35 2022] GET /compute/v2.1/servers/c8f9aa7c-153d-482a-b048-18cd034d21cb => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 21:36:35.665383 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-236ae3fc-7ebe-4b44-9426-ea123ed95a98 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054526572dda44aaa6421ae1a72824a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e2c28ff5bf44018ba1c85b0b7ebc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:35.675056 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-236ae3fc-7ebe-4b44-9426-ea123ed95a98 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] 10.222.0.48 "GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa" status: 200 len: 1314 microversion: 2.1 time: 0.270909 May 03 21:36:35.675619 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 548/1016] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:35 2022] GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:36:35.868024 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-4b546542-5aad-4207-82b1-abbe51b633d2 tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] Action: 'create', calling method: .version_select at 0x7fc84cc42700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-354310237"}} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:36:36.665240 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-4b546542-5aad-4207-82b1-abbe51b633d2 tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.956920 May 03 21:36:36.665847 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 469/1017] 10.222.0.48 () {60 vars in 1154 bytes} [Tue May 3 21:36:35 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 958 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 03 21:36:36.684089 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-a9108417-ea3a-4498-96d8-a3ed3fa19373 tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] Calling method '.version_select at 0x7fc84ca79dc0>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:36.701993 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-4440ca80-b7ba-46d6-a0a1-a7ea6c42fa23 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:36.702697 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-4440ca80-b7ba-46d6-a0a1-a7ea6c42fa23 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] [instance: 59c1d083-841e-41a3-a6a4-33d02ef688aa] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:36.711472 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4440ca80-b7ba-46d6-a0a1-a7ea6c42fa23 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:36.712003 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4440ca80-b7ba-46d6-a0a1-a7ea6c42fa23 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:36.712890 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4440ca80-b7ba-46d6-a0a1-a7ea6c42fa23 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:36.713396 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4440ca80-b7ba-46d6-a0a1-a7ea6c42fa23 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:36.790543 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-a9108417-ea3a-4498-96d8-a3ed3fa19373 tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/c2b64175-739d-4e6c-a303-ab1511073cc8" status: 200 len: 344 microversion: 2.1 time: 0.116889 May 03 21:36:36.791752 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 549/1018] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 3 21:36:36 2022] GET /compute/v2.1/os-volumes/c2b64175-739d-4e6c-a303-ab1511073cc8 => generated 344 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:36:36.806804 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-c13f89a9-4fd6-443c-95de-76f24b9ad1b0 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:36.807364 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-c13f89a9-4fd6-443c-95de-76f24b9ad1b0 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 1233302d-c8af-43d2-9b77-4394d2674961] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:36.815895 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c13f89a9-4fd6-443c-95de-76f24b9ad1b0 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:36.816729 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c13f89a9-4fd6-443c-95de-76f24b9ad1b0 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:36.817746 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c13f89a9-4fd6-443c-95de-76f24b9ad1b0 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:36.818350 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c13f89a9-4fd6-443c-95de-76f24b9ad1b0 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:36.872117 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.wsgi [None req-c13f89a9-4fd6-443c-95de-76f24b9ad1b0 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] HTTP exception thrown: Instance 1233302d-c8af-43d2-9b77-4394d2674961 could not be found. May 03 21:36:36.872761 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-c13f89a9-4fd6-443c-95de-76f24b9ad1b0 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Returning 404 to user: Instance 1233302d-c8af-43d2-9b77-4394d2674961 could not be found. {{(pid=97832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:36:36.873661 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-c13f89a9-4fd6-443c-95de-76f24b9ad1b0 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961" status: 404 len: 111 microversion: 2.1 time: 0.076531 May 03 21:36:36.874322 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 550/1019] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 3 21:36:36 2022] DELETE /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 21:36:36.888553 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-8e0a5bc5-ad40-4e4d-ab11-d1a3ee663597 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:36.889181 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-8e0a5bc5-ad40-4e4d-ab11-d1a3ee663597 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 1233302d-c8af-43d2-9b77-4394d2674961] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:36.896586 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8e0a5bc5-ad40-4e4d-ab11-d1a3ee663597 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:36.897037 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8e0a5bc5-ad40-4e4d-ab11-d1a3ee663597 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:36.898048 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8e0a5bc5-ad40-4e4d-ab11-d1a3ee663597 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:36.898477 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8e0a5bc5-ad40-4e4d-ab11-d1a3ee663597 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:36.949032 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.wsgi [None req-8e0a5bc5-ad40-4e4d-ab11-d1a3ee663597 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] HTTP exception thrown: Instance 1233302d-c8af-43d2-9b77-4394d2674961 could not be found. May 03 21:36:36.949689 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-8e0a5bc5-ad40-4e4d-ab11-d1a3ee663597 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Returning 404 to user: Instance 1233302d-c8af-43d2-9b77-4394d2674961 could not be found. {{(pid=97832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:36:36.950511 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-8e0a5bc5-ad40-4e4d-ab11-d1a3ee663597 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961" status: 404 len: 111 microversion: 2.1 time: 0.071934 May 03 21:36:36.951063 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 551/1020] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:36 2022] GET /compute/v2.1/servers/1233302d-c8af-43d2-9b77-4394d2674961 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 21:36:36.956845 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-4440ca80-b7ba-46d6-a0a1-a7ea6c42fa23 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054526572dda44aaa6421ae1a72824a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e2c28ff5bf44018ba1c85b0b7ebc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:36.964145 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-2f59cdff-bbd6-4566-ac71-a10b76c649c3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:36.964676 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-2f59cdff-bbd6-4566-ac71-a10b76c649c3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:36.966185 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-4440ca80-b7ba-46d6-a0a1-a7ea6c42fa23 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] 10.222.0.48 "GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa" status: 200 len: 1463 microversion: 2.1 time: 0.274722 May 03 21:36:36.966730 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 470/1021] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:36 2022] GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa => generated 1463 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:36:36.971979 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2f59cdff-bbd6-4566-ac71-a10b76c649c3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:36.972451 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2f59cdff-bbd6-4566-ac71-a10b76c649c3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:36.973232 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2f59cdff-bbd6-4566-ac71-a10b76c649c3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:36.973987 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2f59cdff-bbd6-4566-ac71-a10b76c649c3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:37.024826 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.wsgi [None req-2f59cdff-bbd6-4566-ac71-a10b76c649c3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] HTTP exception thrown: Instance 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f could not be found. May 03 21:36:37.025428 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-2f59cdff-bbd6-4566-ac71-a10b76c649c3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Returning 404 to user: Instance 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f could not be found. {{(pid=97832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:36:37.026937 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-2f59cdff-bbd6-4566-ac71-a10b76c649c3 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f" status: 404 len: 111 microversion: 2.1 time: 0.071056 May 03 21:36:37.027369 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 552/1022] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 3 21:36:36 2022] DELETE /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 03 21:36:37.040793 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-1e697ea7-6678-4151-9d70-4a39420c749e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:37.041427 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-1e697ea7-6678-4151-9d70-4a39420c749e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:37.049317 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1e697ea7-6678-4151-9d70-4a39420c749e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:37.049666 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-50723cd4-6bcc-4dcf-979b-89aca0a0737e tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:37.049810 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1e697ea7-6678-4151-9d70-4a39420c749e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:37.050164 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-50723cd4-6bcc-4dcf-979b-89aca0a0737e tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] [instance: 59c1d083-841e-41a3-a6a4-33d02ef688aa] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:37.050560 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1e697ea7-6678-4151-9d70-4a39420c749e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:37.051001 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1e697ea7-6678-4151-9d70-4a39420c749e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:37.057641 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-50723cd4-6bcc-4dcf-979b-89aca0a0737e tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:37.058558 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-50723cd4-6bcc-4dcf-979b-89aca0a0737e tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:37.059465 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-50723cd4-6bcc-4dcf-979b-89aca0a0737e tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:37.059900 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-50723cd4-6bcc-4dcf-979b-89aca0a0737e tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:37.101275 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.wsgi [None req-1e697ea7-6678-4151-9d70-4a39420c749e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] HTTP exception thrown: Instance 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f could not be found. May 03 21:36:37.101885 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-1e697ea7-6678-4151-9d70-4a39420c749e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Returning 404 to user: Instance 4b1e6cc5-801c-4aa5-92fa-1f490590cb9f could not be found. {{(pid=97831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:36:37.102717 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-1e697ea7-6678-4151-9d70-4a39420c749e tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f" status: 404 len: 111 microversion: 2.1 time: 0.071093 May 03 21:36:37.103512 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 471/1023] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:37 2022] GET /compute/v2.1/servers/4b1e6cc5-801c-4aa5-92fa-1f490590cb9f => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 21:36:37.133648 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-50723cd4-6bcc-4dcf-979b-89aca0a0737e tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] [instance: 59c1d083-841e-41a3-a6a4-33d02ef688aa] Going to try to terminate instance {{(pid=97832) delete /opt/stack/nova/nova/compute/api.py:2559}} May 03 21:36:37.373169 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-50723cd4-6bcc-4dcf-979b-89aca0a0737e tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] 10.222.0.48 "DELETE /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa" status: 204 len: 0 microversion: 2.1 time: 0.333858 May 03 21:36:37.373903 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 553/1024] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 3 21:36:37 2022] DELETE /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 03 21:36:37.388649 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-f0398bd3-a89a-47f7-a696-4e0e2e20a233 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:37.389188 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-f0398bd3-a89a-47f7-a696-4e0e2e20a233 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] [instance: 59c1d083-841e-41a3-a6a4-33d02ef688aa] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:37.396594 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f0398bd3-a89a-47f7-a696-4e0e2e20a233 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:37.397105 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f0398bd3-a89a-47f7-a696-4e0e2e20a233 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:37.397967 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f0398bd3-a89a-47f7-a696-4e0e2e20a233 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:37.398399 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f0398bd3-a89a-47f7-a696-4e0e2e20a233 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:37.610765 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-f0398bd3-a89a-47f7-a696-4e0e2e20a233 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054526572dda44aaa6421ae1a72824a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e2c28ff5bf44018ba1c85b0b7ebc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:37.619143 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-f0398bd3-a89a-47f7-a696-4e0e2e20a233 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] 10.222.0.48 "GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa" status: 200 len: 1469 microversion: 2.1 time: 0.240996 May 03 21:36:37.619985 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 472/1025] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:37 2022] GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa => generated 1469 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:36:37.812933 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-35257c6b-8ab1-408a-b01d-d5b307126a0d tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] Calling method '.version_select at 0x7fc84ca799d0>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:37.900841 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-35257c6b-8ab1-408a-b01d-d5b307126a0d tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/c2b64175-739d-4e6c-a303-ab1511073cc8" status: 200 len: 345 microversion: 2.1 time: 0.097667 May 03 21:36:37.902001 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 554/1026] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 3 21:36:37 2022] GET /compute/v2.1/os-volumes/c2b64175-739d-4e6c-a303-ab1511073cc8 => generated 345 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:36:37.918316 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-2faeb110-46d0-4802-b6dd-8820375056cd tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] Action: 'create', calling method: .version_select at 0x7fc84cc42040>, body: {"snapshot": {"volume_id": "c2b64175-739d-4e6c-a303-ab1511073cc8", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-144023391"}} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:36:38.361269 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-2faeb110-46d0-4802-b6dd-8820375056cd tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] 10.222.0.48 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.451871 May 03 21:36:38.361875 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 473/1027] 10.222.0.48 () {60 vars in 1161 bytes} [Tue May 3 21:36:37 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:36:38.378652 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-d62d8b92-fce1-4562-a055-a8982ad0d16e tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] Calling method '.version_select at 0x7fc84cb5e430>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:38.429100 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-d62d8b92-fce1-4562-a055-a8982ad0d16e tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/5f47ec91-d55e-4208-bd9e-2bd14478700c" status: 200 len: 286 microversion: 2.1 time: 0.061022 May 03 21:36:38.429743 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 555/1028] 10.222.0.48 () {58 vars in 1250 bytes} [Tue May 3 21:36:38 2022] GET /compute/v2.1/os-snapshots/5f47ec91-d55e-4208-bd9e-2bd14478700c => generated 286 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:36:38.446873 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-49b66c5d-aeea-4956-99c7-efb7540413c4 tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] Calling method '.version_select at 0x7fc84cb5e040>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:38.447092 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-29853c6c-6bf5-4044-93ba-f644c46218f0 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:38.447603 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-29853c6c-6bf5-4044-93ba-f644c46218f0 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:38.456742 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-29853c6c-6bf5-4044-93ba-f644c46218f0 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:38.457194 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-29853c6c-6bf5-4044-93ba-f644c46218f0 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:38.458084 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-29853c6c-6bf5-4044-93ba-f644c46218f0 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:38.458522 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-29853c6c-6bf5-4044-93ba-f644c46218f0 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:38.497781 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-49b66c5d-aeea-4956-99c7-efb7540413c4 tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.060013 May 03 21:36:38.498341 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 556/1029] 10.222.0.48 () {58 vars in 1139 bytes} [Tue May 3 21:36:38 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:36:38.512406 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.wsgi [None req-29853c6c-6bf5-4044-93ba-f644c46218f0 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] HTTP exception thrown: Instance 12a46337-1502-4a61-8c0d-8b5dd98d5a14 could not be found. May 03 21:36:38.513044 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-29853c6c-6bf5-4044-93ba-f644c46218f0 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Returning 404 to user: Instance 12a46337-1502-4a61-8c0d-8b5dd98d5a14 could not be found. {{(pid=97831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:36:38.513866 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-29853c6c-6bf5-4044-93ba-f644c46218f0 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "DELETE /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14" status: 404 len: 111 microversion: 2.1 time: 0.076221 May 03 21:36:38.514424 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 474/1030] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 3 21:36:38 2022] DELETE /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 21:36:38.517568 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-baa56689-e3fd-4b29-baa8-e2e28287af10 tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] Calling method '.version_select at 0x7fc84cce6790>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:38.528761 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-027e4488-c081-465e-a383-4629c25b7122 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:38.537991 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-027e4488-c081-465e-a383-4629c25b7122 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] [instance: 12a46337-1502-4a61-8c0d-8b5dd98d5a14] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:38.537991 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-027e4488-c081-465e-a383-4629c25b7122 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:38.537991 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-027e4488-c081-465e-a383-4629c25b7122 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:38.538746 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-027e4488-c081-465e-a383-4629c25b7122 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:38.539163 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-027e4488-c081-465e-a383-4629c25b7122 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:38.569121 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-baa56689-e3fd-4b29-baa8-e2e28287af10 tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/5f47ec91-d55e-4208-bd9e-2bd14478700c" status: 200 len: 286 microversion: 2.1 time: 0.063929 May 03 21:36:38.569578 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 557/1031] 10.222.0.48 () {58 vars in 1250 bytes} [Tue May 3 21:36:38 2022] GET /compute/v2.1/os-snapshots/5f47ec91-d55e-4208-bd9e-2bd14478700c => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:36:38.596012 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.wsgi [None req-027e4488-c081-465e-a383-4629c25b7122 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] HTTP exception thrown: Instance 12a46337-1502-4a61-8c0d-8b5dd98d5a14 could not be found. May 03 21:36:38.596649 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-027e4488-c081-465e-a383-4629c25b7122 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] Returning 404 to user: Instance 12a46337-1502-4a61-8c0d-8b5dd98d5a14 could not be found. {{(pid=97831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:36:38.597517 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-027e4488-c081-465e-a383-4629c25b7122 tempest-AttachVolumeNegativeTest-376789705 tempest-AttachVolumeNegativeTest-376789705-project] 10.222.0.48 "GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14" status: 404 len: 111 microversion: 2.1 time: 0.078888 May 03 21:36:38.598080 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 475/1032] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:38 2022] GET /compute/v2.1/servers/12a46337-1502-4a61-8c0d-8b5dd98d5a14 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 21:36:38.650796 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-8c803335-d36e-4985-980c-0fbf8118bd0d tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:38.652122 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-8c803335-d36e-4985-980c-0fbf8118bd0d tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] [instance: 59c1d083-841e-41a3-a6a4-33d02ef688aa] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:38.663793 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8c803335-d36e-4985-980c-0fbf8118bd0d tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:38.665760 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8c803335-d36e-4985-980c-0fbf8118bd0d tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:38.665760 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8c803335-d36e-4985-980c-0fbf8118bd0d tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:38.666401 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8c803335-d36e-4985-980c-0fbf8118bd0d tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:39.081749 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-8c803335-d36e-4985-980c-0fbf8118bd0d tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054526572dda44aaa6421ae1a72824a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e2c28ff5bf44018ba1c85b0b7ebc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:39.092079 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-8c803335-d36e-4985-980c-0fbf8118bd0d tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] 10.222.0.48 "GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa" status: 200 len: 1469 microversion: 2.1 time: 0.457912 May 03 21:36:39.101715 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 558/1033] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:38 2022] GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa => generated 1469 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:36:39.588028 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-06ab92af-9d85-4404-85bd-e3288a312db0 tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] Calling method '.version_select at 0x7fc84cc268b0>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:39.637954 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-06ab92af-9d85-4404-85bd-e3288a312db0 tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/5f47ec91-d55e-4208-bd9e-2bd14478700c" status: 200 len: 286 microversion: 2.1 time: 0.059643 May 03 21:36:39.638929 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 476/1034] 10.222.0.48 () {58 vars in 1250 bytes} [Tue May 3 21:36:39 2022] GET /compute/v2.1/os-snapshots/5f47ec91-d55e-4208-bd9e-2bd14478700c => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:36:40.115820 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-2aa51747-99d9-4054-830f-e9f4e77e0c90 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:40.116458 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-2aa51747-99d9-4054-830f-e9f4e77e0c90 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] [instance: 59c1d083-841e-41a3-a6a4-33d02ef688aa] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:40.125688 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2aa51747-99d9-4054-830f-e9f4e77e0c90 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:40.126140 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2aa51747-99d9-4054-830f-e9f4e77e0c90 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:40.126922 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2aa51747-99d9-4054-830f-e9f4e77e0c90 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:40.127358 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2aa51747-99d9-4054-830f-e9f4e77e0c90 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:40.536181 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-2aa51747-99d9-4054-830f-e9f4e77e0c90 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054526572dda44aaa6421ae1a72824a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e2c28ff5bf44018ba1c85b0b7ebc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:40.546119 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-2aa51747-99d9-4054-830f-e9f4e77e0c90 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] 10.222.0.48 "GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa" status: 200 len: 1469 microversion: 2.1 time: 0.439602 May 03 21:36:40.547103 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 559/1035] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:40 2022] GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa => generated 1469 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:36:40.656381 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-451eab51-4f2e-4602-8de9-a135490e4092 tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] Calling method '.version_select at 0x7fc84cc42940>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:40.703962 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-451eab51-4f2e-4602-8de9-a135490e4092 tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/5f47ec91-d55e-4208-bd9e-2bd14478700c" status: 200 len: 286 microversion: 2.1 time: 0.057823 May 03 21:36:40.708012 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 477/1036] 10.222.0.48 () {58 vars in 1250 bytes} [Tue May 3 21:36:40 2022] GET /compute/v2.1/os-snapshots/5f47ec91-d55e-4208-bd9e-2bd14478700c => generated 286 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:36:41.576541 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-6a25157d-e2c0-4bd8-b726-2f3fc19c9287 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:41.578384 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-6a25157d-e2c0-4bd8-b726-2f3fc19c9287 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] [instance: 59c1d083-841e-41a3-a6a4-33d02ef688aa] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:41.590065 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6a25157d-e2c0-4bd8-b726-2f3fc19c9287 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:41.590731 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6a25157d-e2c0-4bd8-b726-2f3fc19c9287 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:41.591914 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6a25157d-e2c0-4bd8-b726-2f3fc19c9287 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:41.592601 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6a25157d-e2c0-4bd8-b726-2f3fc19c9287 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:41.723526 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-ffbdbe53-c46b-4b0e-bec1-5577f3f2ef87 tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] Calling method '.version_select at 0x7fc84cc428b0>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:41.784220 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-ffbdbe53-c46b-4b0e-bec1-5577f3f2ef87 tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/5f47ec91-d55e-4208-bd9e-2bd14478700c" status: 200 len: 287 microversion: 2.1 time: 0.072737 May 03 21:36:41.785046 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 478/1037] 10.222.0.48 () {58 vars in 1250 bytes} [Tue May 3 21:36:41 2022] GET /compute/v2.1/os-snapshots/5f47ec91-d55e-4208-bd9e-2bd14478700c => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:36:41.805816 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-53d676e2-6e56-49c1-8ad2-c3f4fc7c3fc6 tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] Calling method '.version_select at 0x7fc84cc42790>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:41.908087 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-6a25157d-e2c0-4bd8-b726-2f3fc19c9287 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054526572dda44aaa6421ae1a72824a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e2c28ff5bf44018ba1c85b0b7ebc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:41.922383 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-6a25157d-e2c0-4bd8-b726-2f3fc19c9287 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] 10.222.0.48 "GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa" status: 200 len: 1469 microversion: 2.1 time: 0.361553 May 03 21:36:41.931662 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 560/1038] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:41 2022] GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa => generated 1469 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:36:41.989562 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-53d676e2-6e56-49c1-8ad2-c3f4fc7c3fc6 tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] 10.222.0.48 "DELETE /compute/v2.1/os-snapshots/5f47ec91-d55e-4208-bd9e-2bd14478700c" status: 202 len: 0 microversion: 2.1 time: 0.195988 May 03 21:36:41.990191 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 479/1039] 10.222.0.48 () {58 vars in 1253 bytes} [Tue May 3 21:36:41 2022] DELETE /compute/v2.1/os-snapshots/5f47ec91-d55e-4208-bd9e-2bd14478700c => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 03 21:36:42.005186 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-329cda15-16ba-4375-979c-f30b64c781d9 tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] Calling method '.version_select at 0x7fc84ca799d0>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:42.062988 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-329cda15-16ba-4375-979c-f30b64c781d9 tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/5f47ec91-d55e-4208-bd9e-2bd14478700c" status: 200 len: 286 microversion: 2.1 time: 0.068074 May 03 21:36:42.064300 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 561/1040] 10.222.0.48 () {58 vars in 1250 bytes} [Tue May 3 21:36:41 2022] GET /compute/v2.1/os-snapshots/5f47ec91-d55e-4208-bd9e-2bd14478700c => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:36:42.382456 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-b19dfe5c-df4e-44bf-a42d-2d1c6aea0a76 req-b6022c73-d4d4-4930-a807-7653ded3a389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59c1d083-841e-41a3-a6a4-33d02ef688aa", "name": "network-vif-deleted", "tag": "056ed7bb-a24e-42bf-8812-f1984a9af040"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:36:42.391200 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:36:42.391200 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:36:42.400244 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-b19dfe5c-df4e-44bf-a42d-2d1c6aea0a76 req-b6022c73-d4d4-4930-a807-7653ded3a389 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:42.404390 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-b19dfe5c-df4e-44bf-a42d-2d1c6aea0a76 req-b6022c73-d4d4-4930-a807-7653ded3a389 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:42.420852 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-b19dfe5c-df4e-44bf-a42d-2d1c6aea0a76 req-b6022c73-d4d4-4930-a807-7653ded3a389 service nova] Creating event network-vif-deleted:056ed7bb-a24e-42bf-8812-f1984a9af040 for instance 59c1d083-841e-41a3-a6a4-33d02ef688aa on hv-cinder-84037 May 03 21:36:42.426613 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-b19dfe5c-df4e-44bf-a42d-2d1c6aea0a76 req-b6022c73-d4d4-4930-a807-7653ded3a389 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056956 May 03 21:36:42.430465 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 480/1041] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:36:42.950214 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-33920d6f-7109-4537-a1b1-41d2e7a906e4 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:42.951561 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-33920d6f-7109-4537-a1b1-41d2e7a906e4 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] [instance: 59c1d083-841e-41a3-a6a4-33d02ef688aa] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:42.961909 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-33920d6f-7109-4537-a1b1-41d2e7a906e4 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:42.964031 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-33920d6f-7109-4537-a1b1-41d2e7a906e4 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:42.965089 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-33920d6f-7109-4537-a1b1-41d2e7a906e4 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:42.966421 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-33920d6f-7109-4537-a1b1-41d2e7a906e4 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:43.052170 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-33920d6f-7109-4537-a1b1-41d2e7a906e4 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:43.052754 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-33920d6f-7109-4537-a1b1-41d2e7a906e4 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:43.053106 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.objects.instance [None req-33920d6f-7109-4537-a1b1-41d2e7a906e4 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lazy-loading 'fault' on Instance uuid 59c1d083-841e-41a3-a6a4-33d02ef688aa {{(pid=97832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 03 21:36:43.087587 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-54acad10-8463-4b3c-be24-07010623d020 tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] Calling method '.version_select at 0x7fc84cc42ee0>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:43.147813 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.wsgi [None req-54acad10-8463-4b3c-be24-07010623d020 tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] HTTP exception thrown: Snapshot 5f47ec91-d55e-4208-bd9e-2bd14478700c could not be found. May 03 21:36:43.148408 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-54acad10-8463-4b3c-be24-07010623d020 tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] Returning 404 to user: Snapshot 5f47ec91-d55e-4208-bd9e-2bd14478700c could not be found. {{(pid=97831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:36:43.149246 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-54acad10-8463-4b3c-be24-07010623d020 tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/5f47ec91-d55e-4208-bd9e-2bd14478700c" status: 404 len: 111 microversion: 2.1 time: 0.072027 May 03 21:36:43.149804 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 481/1042] 10.222.0.48 () {58 vars in 1250 bytes} [Tue May 3 21:36:43 2022] GET /compute/v2.1/os-snapshots/5f47ec91-d55e-4208-bd9e-2bd14478700c => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 21:36:43.164984 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-26c22c01-b917-42e3-bcb9-cbb3436b50c4 tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] Calling method '.version_select at 0x7fc84cc26670>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:43.252453 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-33920d6f-7109-4537-a1b1-41d2e7a906e4 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054526572dda44aaa6421ae1a72824a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e2c28ff5bf44018ba1c85b0b7ebc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:36:43.269783 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-33920d6f-7109-4537-a1b1-41d2e7a906e4 tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] 10.222.0.48 "GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa" status: 200 len: 1304 microversion: 2.1 time: 0.332817 May 03 21:36:43.272465 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 562/1043] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:42 2022] GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa => generated 1304 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:36:43.444376 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-26c22c01-b917-42e3-bcb9-cbb3436b50c4 tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/c2b64175-739d-4e6c-a303-ab1511073cc8" status: 202 len: 0 microversion: 2.1 time: 0.288341 May 03 21:36:43.450046 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 482/1044] 10.222.0.48 () {58 vars in 1247 bytes} [Tue May 3 21:36:43 2022] DELETE /compute/v2.1/os-volumes/c2b64175-739d-4e6c-a303-ab1511073cc8 => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 21:36:43.459076 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-bc385330-f98b-4283-bbfd-a6fbd080ecc1 tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] Calling method '.version_select at 0x7fc84cb5e310>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:43.547943 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-bc385330-f98b-4283-bbfd-a6fbd080ecc1 tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/c2b64175-739d-4e6c-a303-ab1511073cc8" status: 200 len: 344 microversion: 2.1 time: 0.097902 May 03 21:36:43.548532 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 563/1045] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 3 21:36:43 2022] GET /compute/v2.1/os-volumes/c2b64175-739d-4e6c-a303-ab1511073cc8 => generated 344 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:36:44.295395 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-5f4da5ca-3ff3-4e97-9126-b690ba5c1b1f tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:44.296458 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-5f4da5ca-3ff3-4e97-9126-b690ba5c1b1f tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] [instance: 59c1d083-841e-41a3-a6a4-33d02ef688aa] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:44.304447 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5f4da5ca-3ff3-4e97-9126-b690ba5c1b1f tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:44.305189 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5f4da5ca-3ff3-4e97-9126-b690ba5c1b1f tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:44.306215 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5f4da5ca-3ff3-4e97-9126-b690ba5c1b1f tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:44.306728 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5f4da5ca-3ff3-4e97-9126-b690ba5c1b1f tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:44.363359 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.wsgi [None req-5f4da5ca-3ff3-4e97-9126-b690ba5c1b1f tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] HTTP exception thrown: Instance 59c1d083-841e-41a3-a6a4-33d02ef688aa could not be found. May 03 21:36:44.364222 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-5f4da5ca-3ff3-4e97-9126-b690ba5c1b1f tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] Returning 404 to user: Instance 59c1d083-841e-41a3-a6a4-33d02ef688aa could not be found. {{(pid=97831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:36:44.365974 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-5f4da5ca-3ff3-4e97-9126-b690ba5c1b1f tempest-VolumesNegativeTest-1856245104 tempest-VolumesNegativeTest-1856245104-project] 10.222.0.48 "GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa" status: 404 len: 111 microversion: 2.1 time: 0.081442 May 03 21:36:44.365974 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 483/1046] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:36:44 2022] GET /compute/v2.1/servers/59c1d083-841e-41a3-a6a4-33d02ef688aa => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 21:36:44.567197 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-40db0323-544a-40f8-9a43-a79354bf948f tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] Calling method '.version_select at 0x7fc84ca79e50>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:44.635240 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.wsgi [None req-40db0323-544a-40f8-9a43-a79354bf948f tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] HTTP exception thrown: Volume c2b64175-739d-4e6c-a303-ab1511073cc8 could not be found. May 03 21:36:44.639495 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-40db0323-544a-40f8-9a43-a79354bf948f tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] Returning 404 to user: Volume c2b64175-739d-4e6c-a303-ab1511073cc8 could not be found. {{(pid=97832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:36:44.639495 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-40db0323-544a-40f8-9a43-a79354bf948f tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/c2b64175-739d-4e6c-a303-ab1511073cc8" status: 404 len: 109 microversion: 2.1 time: 0.080484 May 03 21:36:44.639495 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 564/1047] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 3 21:36:44 2022] GET /compute/v2.1/os-volumes/c2b64175-739d-4e6c-a303-ab1511073cc8 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 21:36:44.652751 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-b0038070-6337-4cd8-89a5-10b8d0fafcef tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] Calling method '.version_select at 0x7fc84c9069d0>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:44.753615 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.wsgi [None req-b0038070-6337-4cd8-89a5-10b8d0fafcef tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] HTTP exception thrown: Volume c2b64175-739d-4e6c-a303-ab1511073cc8 could not be found. May 03 21:36:44.753615 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-b0038070-6337-4cd8-89a5-10b8d0fafcef tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] Returning 404 to user: Volume c2b64175-739d-4e6c-a303-ab1511073cc8 could not be found. {{(pid=97831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:36:44.753615 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-b0038070-6337-4cd8-89a5-10b8d0fafcef tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/c2b64175-739d-4e6c-a303-ab1511073cc8" status: 404 len: 109 microversion: 2.1 time: 0.112120 May 03 21:36:44.753615 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 484/1048] 10.222.0.48 () {58 vars in 1247 bytes} [Tue May 3 21:36:44 2022] DELETE /compute/v2.1/os-volumes/c2b64175-739d-4e6c-a303-ab1511073cc8 => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 21:36:44.777477 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-2d6431fc-5dc9-4fc2-a90a-35b7caf4be1c tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] Calling method '.version_select at 0x7fc84ca791f0>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:44.854145 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.wsgi [None req-2d6431fc-5dc9-4fc2-a90a-35b7caf4be1c tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] HTTP exception thrown: Volume c2b64175-739d-4e6c-a303-ab1511073cc8 could not be found. May 03 21:36:44.855079 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-2d6431fc-5dc9-4fc2-a90a-35b7caf4be1c tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] Returning 404 to user: Volume c2b64175-739d-4e6c-a303-ab1511073cc8 could not be found. {{(pid=97832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:36:44.857414 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-2d6431fc-5dc9-4fc2-a90a-35b7caf4be1c tempest-VolumesSnapshotsTestJSON-1399223493 tempest-VolumesSnapshotsTestJSON-1399223493-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/c2b64175-739d-4e6c-a303-ab1511073cc8" status: 404 len: 109 microversion: 2.1 time: 0.092365 May 03 21:36:44.858186 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 565/1049] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 3 21:36:44 2022] GET /compute/v2.1/os-volumes/c2b64175-739d-4e6c-a303-ab1511073cc8 => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 21:36:49.964919 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-9cb49cc0-3621-4796-91ba-ea0357ba2b95 tempest-VolumesTestJSON-1206356004 tempest-VolumesTestJSON-1206356004-project] Calling method '.version_select at 0x7fc84ce339d0>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:50.066062 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-9cb49cc0-3621-4796-91ba-ea0357ba2b95 tempest-VolumesTestJSON-1206356004 tempest-VolumesTestJSON-1206356004-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/7438cb60-63e0-4a22-a822-60ecb57408bd" status: 200 len: 351 microversion: 2.1 time: 0.111408 May 03 21:36:50.073776 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 485/1050] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 3 21:36:49 2022] GET /compute/v2.1/os-volumes/7438cb60-63e0-4a22-a822-60ecb57408bd => generated 351 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:36:52.067226 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-7844a86e-4835-4c1a-aa9f-3eb03a8a417b tempest-VolumesTestJSON-1206356004 tempest-VolumesTestJSON-1206356004-project] Calling method '.version_select at 0x7fc84cebbe50>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:52.159362 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-7844a86e-4835-4c1a-aa9f-3eb03a8a417b tempest-VolumesTestJSON-1206356004 tempest-VolumesTestJSON-1206356004-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/4d948d28-f894-40bb-8111-cb640d4e7cf6" status: 200 len: 351 microversion: 2.1 time: 0.100574 May 03 21:36:52.164480 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 566/1051] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 3 21:36:52 2022] GET /compute/v2.1/os-volumes/4d948d28-f894-40bb-8111-cb640d4e7cf6 => generated 351 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:36:53.901716 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-fdedf082-980a-4038-abb2-342f148c3d3d tempest-VolumesTestJSON-1206356004 tempest-VolumesTestJSON-1206356004-project] Calling method '.version_select at 0x7fc84cc425e0>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:53.990645 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-fdedf082-980a-4038-abb2-342f148c3d3d tempest-VolumesTestJSON-1206356004 tempest-VolumesTestJSON-1206356004-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/5b4d2d7d-1c8a-4e56-9ccf-5a1d0c3494a2" status: 200 len: 350 microversion: 2.1 time: 0.098302 May 03 21:36:53.992697 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 486/1052] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 3 21:36:53 2022] GET /compute/v2.1/os-volumes/5b4d2d7d-1c8a-4e56-9ccf-5a1d0c3494a2 => generated 350 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:36:54.008960 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-fde430db-4042-4be1-a22b-b02b96f33e55 tempest-VolumesTestJSON-1206356004 tempest-VolumesTestJSON-1206356004-project] Calling method '.version_select at 0x7fc84ca79040>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:54.097747 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-fde430db-4042-4be1-a22b-b02b96f33e55 tempest-VolumesTestJSON-1206356004 tempest-VolumesTestJSON-1206356004-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.098001 May 03 21:36:54.098629 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 567/1053] 10.222.0.48 () {58 vars in 1133 bytes} [Tue May 3 21:36:53 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:36:54.123920 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-c477b460-b562-4c50-847d-706b199abe23 tempest-VolumesTestJSON-1206356004 tempest-VolumesTestJSON-1206356004-project] Calling method '.version_select at 0x7fc84c906670>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:54.223843 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-c477b460-b562-4c50-847d-706b199abe23 tempest-VolumesTestJSON-1206356004 tempest-VolumesTestJSON-1206356004-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.111202 May 03 21:36:54.224464 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 487/1054] 10.222.0.48 () {58 vars in 1148 bytes} [Tue May 3 21:36:54 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:36:54.242476 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-df5acb6b-9cbd-4fbe-b5bb-ac62801a660c tempest-VolumesTestJSON-1206356004 tempest-VolumesTestJSON-1206356004-project] Calling method '.version_select at 0x7fc84cbab5e0>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:54.357126 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-df5acb6b-9cbd-4fbe-b5bb-ac62801a660c tempest-VolumesTestJSON-1206356004 tempest-VolumesTestJSON-1206356004-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.123649 May 03 21:36:54.357733 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 568/1055] 10.222.0.48 () {58 vars in 1133 bytes} [Tue May 3 21:36:54 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:36:54.374514 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-7232d967-c52b-4462-85c5-85ec67e1b160 tempest-VolumesTestJSON-1206356004 tempest-VolumesTestJSON-1206356004-project] Calling method '.version_select at 0x7fc84cbe60d0>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:54.494815 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-7232d967-c52b-4462-85c5-85ec67e1b160 tempest-VolumesTestJSON-1206356004 tempest-VolumesTestJSON-1206356004-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.128471 May 03 21:36:54.498748 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 488/1056] 10.222.0.48 () {58 vars in 1166 bytes} [Tue May 3 21:36:54 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:36:54.524342 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-745d213d-98b5-4299-8573-a7448c696d02 tempest-VolumesTestJSON-1206356004 tempest-VolumesTestJSON-1206356004-project] Calling method '.version_select at 0x7fc84ce22280>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:54.640162 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-745d213d-98b5-4299-8573-a7448c696d02 tempest-VolumesTestJSON-1206356004 tempest-VolumesTestJSON-1206356004-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.134969 May 03 21:36:54.640982 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 569/1057] 10.222.0.48 () {58 vars in 1169 bytes} [Tue May 3 21:36:54 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:36:54.658909 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-e6bef24c-11a3-47da-b40a-3a5ba4fde64a tempest-VolumesTestJSON-1206356004 tempest-VolumesTestJSON-1206356004-project] Calling method '.version_select at 0x7fc84cd92670>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:54.771230 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-e6bef24c-11a3-47da-b40a-3a5ba4fde64a tempest-VolumesTestJSON-1206356004 tempest-VolumesTestJSON-1206356004-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.121925 May 03 21:36:54.771801 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 489/1058] 10.222.0.48 () {58 vars in 1154 bytes} [Tue May 3 21:36:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:36:54.793379 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-f8bc5052-9b84-4e11-a321-53566ecf0e08 tempest-VolumesTestJSON-1206356004 tempest-VolumesTestJSON-1206356004-project] Calling method '.version_select at 0x7fc84ce22ca0>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:54.888607 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-f8bc5052-9b84-4e11-a321-53566ecf0e08 tempest-VolumesTestJSON-1206356004 tempest-VolumesTestJSON-1206356004-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.108473 May 03 21:36:54.889387 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 570/1059] 10.222.0.48 () {58 vars in 1187 bytes} [Tue May 3 21:36:54 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:36:54.908569 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-56a891c8-53fa-4c91-a7a1-db951982a17e tempest-VolumesTestJSON-1206356004 tempest-VolumesTestJSON-1206356004-project] Calling method '.version_select at 0x7fc84cc423a0>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:55.002407 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-56a891c8-53fa-4c91-a7a1-db951982a17e tempest-VolumesTestJSON-1206356004 tempest-VolumesTestJSON-1206356004-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.102784 May 03 21:36:55.003063 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 490/1060] 10.222.0.48 () {58 vars in 1154 bytes} [Tue May 3 21:36:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:36:59.202820 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-d7c52733-9744-42a4-b146-b952a4a4cf62 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:59.203678 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-d7c52733-9744-42a4-b146-b952a4a4cf62 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:59.218076 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d7c52733-9744-42a4-b146-b952a4a4cf62 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:59.218556 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d7c52733-9744-42a4-b146-b952a4a4cf62 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:59.219355 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d7c52733-9744-42a4-b146-b952a4a4cf62 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:59.219791 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d7c52733-9744-42a4-b146-b952a4a4cf62 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:59.296903 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-d7c52733-9744-42a4-b146-b952a4a4cf62 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.108678 May 03 21:36:59.297489 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 571/1061] 10.222.0.48 () {60 vars in 1342 bytes} [Tue May 3 21:36:59 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469/os-volume_attachments => generated 25 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:36:59.401897 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-13e67b9b-020b-4bd8-a6b7-441336ecdf78 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:36:59.403068 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-13e67b9b-020b-4bd8-a6b7-441336ecdf78 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:36:59.412588 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-13e67b9b-020b-4bd8-a6b7-441336ecdf78 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:59.413312 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-13e67b9b-020b-4bd8-a6b7-441336ecdf78 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:59.414151 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-13e67b9b-020b-4bd8-a6b7-441336ecdf78 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:36:59.414594 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-13e67b9b-020b-4bd8-a6b7-441336ecdf78 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:36:59.487083 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-13e67b9b-020b-4bd8-a6b7-441336ecdf78 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Going to try to terminate instance {{(pid=97831) delete /opt/stack/nova/nova/compute/api.py:2559}} May 03 21:36:59.971893 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-13e67b9b-020b-4bd8-a6b7-441336ecdf78 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "DELETE /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 204 len: 0 microversion: 2.20 time: 0.579940 May 03 21:36:59.984849 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 491/1062] 10.222.0.48 () {60 vars in 1279 bytes} [Tue May 3 21:36:59 2022] DELETE /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 03 21:37:00.000706 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-5689f510-961e-4cf4-99ad-81da2db7d565 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:00.001345 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-5689f510-961e-4cf4-99ad-81da2db7d565 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:00.016116 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5689f510-961e-4cf4-99ad-81da2db7d565 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:00.019420 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5689f510-961e-4cf4-99ad-81da2db7d565 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:00.019420 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5689f510-961e-4cf4-99ad-81da2db7d565 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:00.019420 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5689f510-961e-4cf4-99ad-81da2db7d565 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:00.843430 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-5689f510-961e-4cf4-99ad-81da2db7d565 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:00.903277 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-5689f510-961e-4cf4-99ad-81da2db7d565 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:00.927401 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-5689f510-961e-4cf4-99ad-81da2db7d565 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:00.937856 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-5689f510-961e-4cf4-99ad-81da2db7d565 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1723 microversion: 2.20 time: 0.953125 May 03 21:37:00.980614 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 572/1063] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:36:59 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1723 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:37:02.012144 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-3f68d0e7-f998-4b8d-bf7b-942901f8ed74 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:02.014829 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-3f68d0e7-f998-4b8d-bf7b-942901f8ed74 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:02.030075 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-3f68d0e7-f998-4b8d-bf7b-942901f8ed74 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:02.031135 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-3f68d0e7-f998-4b8d-bf7b-942901f8ed74 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:02.032993 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-3f68d0e7-f998-4b8d-bf7b-942901f8ed74 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:02.033991 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-3f68d0e7-f998-4b8d-bf7b-942901f8ed74 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:02.920373 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-3f68d0e7-f998-4b8d-bf7b-942901f8ed74 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:02.940131 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-3f68d0e7-f998-4b8d-bf7b-942901f8ed74 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:02.948851 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-3f68d0e7-f998-4b8d-bf7b-942901f8ed74 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:02.950387 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-3f68d0e7-f998-4b8d-bf7b-942901f8ed74 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1723 microversion: 2.20 time: 0.970168 May 03 21:37:02.951412 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 492/1064] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:37:01 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1723 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:37:03.896729 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-f604655a-40a1-4010-89f7-ed912f1e97c4 req-c0171b2d-abdb-4a6a-82f1-ec7fb9dd2043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49b86a80-657d-4e94-bc71-bcfe8f276469", "name": "network-vif-deleted", "tag": "4a088512-8058-4a9a-a45b-177671d97cfc"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:37:03.918095 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:37:03.918095 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:37:03.929800 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-f604655a-40a1-4010-89f7-ed912f1e97c4 req-c0171b2d-abdb-4a6a-82f1-ec7fb9dd2043 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:03.930525 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-f604655a-40a1-4010-89f7-ed912f1e97c4 req-c0171b2d-abdb-4a6a-82f1-ec7fb9dd2043 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:03.956132 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-f604655a-40a1-4010-89f7-ed912f1e97c4 req-c0171b2d-abdb-4a6a-82f1-ec7fb9dd2043 service nova] Creating event network-vif-deleted:4a088512-8058-4a9a-a45b-177671d97cfc for instance 49b86a80-657d-4e94-bc71-bcfe8f276469 on hv-cinder-84037 May 03 21:37:03.967654 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-f604655a-40a1-4010-89f7-ed912f1e97c4 req-c0171b2d-abdb-4a6a-82f1-ec7fb9dd2043 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083186 May 03 21:37:03.968393 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 573/1065] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:37:03.979891 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-207770a8-31c0-4c29-955c-a225da2b553f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:03.981208 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-207770a8-31c0-4c29-955c-a225da2b553f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:03.989939 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-207770a8-31c0-4c29-955c-a225da2b553f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:03.990691 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-207770a8-31c0-4c29-955c-a225da2b553f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:03.992026 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-207770a8-31c0-4c29-955c-a225da2b553f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:03.992818 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-207770a8-31c0-4c29-955c-a225da2b553f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:04.423697 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-207770a8-31c0-4c29-955c-a225da2b553f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:04.469266 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-207770a8-31c0-4c29-955c-a225da2b553f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:04.481014 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-207770a8-31c0-4c29-955c-a225da2b553f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f7bb76fefa8402db231ed466d351631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf52ffb4a864a689f5d0242ddc4cc4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:04.482773 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-207770a8-31c0-4c29-955c-a225da2b553f tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 200 len: 1656 microversion: 2.20 time: 0.513474 May 03 21:37:04.483872 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 493/1066] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:37:03 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 1656 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 03 21:37:05.508614 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-b6c39da2-af56-482b-bd5b-2c72b0881ba9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:05.510156 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-b6c39da2-af56-482b-bd5b-2c72b0881ba9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:05.518272 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b6c39da2-af56-482b-bd5b-2c72b0881ba9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:05.518696 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b6c39da2-af56-482b-bd5b-2c72b0881ba9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:05.519657 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b6c39da2-af56-482b-bd5b-2c72b0881ba9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:05.520239 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-b6c39da2-af56-482b-bd5b-2c72b0881ba9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:05.577618 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.wsgi [None req-b6c39da2-af56-482b-bd5b-2c72b0881ba9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] HTTP exception thrown: Instance 49b86a80-657d-4e94-bc71-bcfe8f276469 could not be found. May 03 21:37:05.578220 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-b6c39da2-af56-482b-bd5b-2c72b0881ba9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Returning 404 to user: Instance 49b86a80-657d-4e94-bc71-bcfe8f276469 could not be found. {{(pid=97832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:37:05.579033 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-b6c39da2-af56-482b-bd5b-2c72b0881ba9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 404 len: 111 microversion: 2.20 time: 0.081210 May 03 21:37:05.580070 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 574/1067] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:37:05 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 03 21:37:05.595895 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-270f9d26-b824-41db-97af-6cbed3fad5c3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '.version_select at 0x7fc84c906670>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:05.699609 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-270f9d26-b824-41db-97af-6cbed3fad5c3 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2026851875" status: 204 len: 0 microversion: 2.20 time: 0.114026 May 03 21:37:05.700402 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 494/1068] 10.222.0.48 () {60 vars in 1261 bytes} [Tue May 3 21:37:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2026851875 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 03 21:37:09.014147 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-d36de317-1420-4075-9731-47db42a16309 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:09.016949 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-d36de317-1420-4075-9731-47db42a16309 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:09.028483 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d36de317-1420-4075-9731-47db42a16309 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:09.029250 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d36de317-1420-4075-9731-47db42a16309 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:09.030227 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d36de317-1420-4075-9731-47db42a16309 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:09.030844 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d36de317-1420-4075-9731-47db42a16309 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:09.293010 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.wsgi [None req-d36de317-1420-4075-9731-47db42a16309 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] HTTP exception thrown: Instance 49b86a80-657d-4e94-bc71-bcfe8f276469 could not be found. May 03 21:37:09.293797 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-d36de317-1420-4075-9731-47db42a16309 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Returning 404 to user: Instance 49b86a80-657d-4e94-bc71-bcfe8f276469 could not be found. {{(pid=97832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:37:09.294551 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-d36de317-1420-4075-9731-47db42a16309 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "DELETE /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 404 len: 111 microversion: 2.20 time: 0.295578 May 03 21:37:09.295322 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 575/1069] 10.222.0.48 () {60 vars in 1279 bytes} [Tue May 3 21:37:08 2022] DELETE /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 111 bytes in 297 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 03 21:37:09.309314 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-ffe7fa9c-8321-4787-bdb9-9de82cc1e5a0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:09.320270 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-ffe7fa9c-8321-4787-bdb9-9de82cc1e5a0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 49b86a80-657d-4e94-bc71-bcfe8f276469] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:09.320270 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ffe7fa9c-8321-4787-bdb9-9de82cc1e5a0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:09.320270 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ffe7fa9c-8321-4787-bdb9-9de82cc1e5a0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:09.322064 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ffe7fa9c-8321-4787-bdb9-9de82cc1e5a0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:09.322603 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ffe7fa9c-8321-4787-bdb9-9de82cc1e5a0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:09.377250 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.wsgi [None req-ffe7fa9c-8321-4787-bdb9-9de82cc1e5a0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] HTTP exception thrown: Instance 49b86a80-657d-4e94-bc71-bcfe8f276469 could not be found. May 03 21:37:09.377860 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-ffe7fa9c-8321-4787-bdb9-9de82cc1e5a0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Returning 404 to user: Instance 49b86a80-657d-4e94-bc71-bcfe8f276469 could not be found. {{(pid=97831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:37:09.378690 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-ffe7fa9c-8321-4787-bdb9-9de82cc1e5a0 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469" status: 404 len: 111 microversion: 2.20 time: 0.078933 May 03 21:37:09.379250 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 495/1070] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:37:09 2022] GET /compute/v2.1/servers/49b86a80-657d-4e94-bc71-bcfe8f276469 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 03 21:37:11.011993 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-7d951377-fd56-4378-8010-f8792ed5b1be tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:11.011993 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-7d951377-fd56-4378-8010-f8792ed5b1be tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:11.030155 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7d951377-fd56-4378-8010-f8792ed5b1be tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:11.030603 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7d951377-fd56-4378-8010-f8792ed5b1be tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:11.036694 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7d951377-fd56-4378-8010-f8792ed5b1be tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:11.037397 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7d951377-fd56-4378-8010-f8792ed5b1be tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:11.128489 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.wsgi [None req-7d951377-fd56-4378-8010-f8792ed5b1be tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] HTTP exception thrown: Instance 77f6a8a2-4366-486d-a002-05587e0f46b5 could not be found. May 03 21:37:11.129593 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-7d951377-fd56-4378-8010-f8792ed5b1be tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Returning 404 to user: Instance 77f6a8a2-4366-486d-a002-05587e0f46b5 could not be found. {{(pid=97832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:37:11.130259 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-7d951377-fd56-4378-8010-f8792ed5b1be tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "DELETE /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 404 len: 111 microversion: 2.20 time: 0.143455 May 03 21:37:11.134780 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 576/1071] 10.222.0.48 () {60 vars in 1279 bytes} [Tue May 3 21:37:10 2022] DELETE /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 03 21:37:11.151451 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-4bdc3c1b-5037-4764-b818-5f08d1e922f9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:11.152289 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-4bdc3c1b-5037-4764-b818-5f08d1e922f9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] [instance: 77f6a8a2-4366-486d-a002-05587e0f46b5] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:11.169416 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4bdc3c1b-5037-4764-b818-5f08d1e922f9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:11.170764 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4bdc3c1b-5037-4764-b818-5f08d1e922f9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:11.171880 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4bdc3c1b-5037-4764-b818-5f08d1e922f9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:11.172348 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4bdc3c1b-5037-4764-b818-5f08d1e922f9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:11.248473 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.wsgi [None req-4bdc3c1b-5037-4764-b818-5f08d1e922f9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] HTTP exception thrown: Instance 77f6a8a2-4366-486d-a002-05587e0f46b5 could not be found. May 03 21:37:11.249367 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-4bdc3c1b-5037-4764-b818-5f08d1e922f9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] Returning 404 to user: Instance 77f6a8a2-4366-486d-a002-05587e0f46b5 could not be found. {{(pid=97831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:37:11.250487 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-4bdc3c1b-5037-4764-b818-5f08d1e922f9 tempest-AttachVolumeShelveTestJSON-772578212 tempest-AttachVolumeShelveTestJSON-772578212-project] 10.222.0.48 "GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5" status: 404 len: 111 microversion: 2.20 time: 0.111659 May 03 21:37:11.252968 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 496/1072] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 3 21:37:11 2022] GET /compute/v2.1/servers/77f6a8a2-4366-486d-a002-05587e0f46b5 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 03 21:37:17.131939 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-13d0773e-34e1-414c-936e-5b56a45dc50c tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Action: 'create', calling method: .version_select at 0x7fc84cb5e160>, body: {"keypair": {"name": "tempest-TestShelveInstance-1858174847"}} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:37:17.198609 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-13d0773e-34e1-414c-936e-5b56a45dc50c tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Getting quotas for project eca9727df4a44eaaa12b84e3f0df0b51. Resources: {'key_pairs'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:37:17.204407 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-13d0773e-34e1-414c-936e-5b56a45dc50c tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Getting quotas for user bc7706b8821948b6bbfe86a3805f7461 and project eca9727df4a44eaaa12b84e3f0df0b51. Resources: {'key_pairs'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:37:17.516798 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-13d0773e-34e1-414c-936e-5b56a45dc50c tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Getting quotas for project eca9727df4a44eaaa12b84e3f0df0b51. Resources: {'key_pairs'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:37:17.520785 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.quota [None req-13d0773e-34e1-414c-936e-5b56a45dc50c tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Getting quotas for user bc7706b8821948b6bbfe86a3805f7461 and project eca9727df4a44eaaa12b84e3f0df0b51. Resources: {'key_pairs'} {{(pid=97832) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:37:17.535380 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-13d0773e-34e1-414c-936e-5b56a45dc50c tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.711607 May 03 21:37:17.536149 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 577/1073] 10.222.0.48 () {60 vars in 1157 bytes} [Tue May 3 21:37:16 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:37:30.823253 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-0582349d-6c8f-4bd1-94b5-4ae394d94359 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:30.824597 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-0582349d-6c8f-4bd1-94b5-4ae394d94359 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 4e3930f0-3a9f-4d20-ae74-434e66c18c46] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:30.834580 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0582349d-6c8f-4bd1-94b5-4ae394d94359 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:30.835284 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0582349d-6c8f-4bd1-94b5-4ae394d94359 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:30.836925 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0582349d-6c8f-4bd1-94b5-4ae394d94359 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:30.837494 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0582349d-6c8f-4bd1-94b5-4ae394d94359 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:30.908404 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-0582349d-6c8f-4bd1-94b5-4ae394d94359 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 4e3930f0-3a9f-4d20-ae74-434e66c18c46] Going to try to terminate instance {{(pid=97831) delete /opt/stack/nova/nova/compute/api.py:2559}} May 03 21:37:31.313231 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-0582349d-6c8f-4bd1-94b5-4ae394d94359 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46" status: 204 len: 0 microversion: 2.1 time: 0.503341 May 03 21:37:31.314022 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 497/1074] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 3 21:37:30 2022] DELETE /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 03 21:37:31.329838 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-e99a99e3-51dc-480a-9293-9dfc87a8357b tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:31.334189 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-e99a99e3-51dc-480a-9293-9dfc87a8357b tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 4e3930f0-3a9f-4d20-ae74-434e66c18c46] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:31.343655 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e99a99e3-51dc-480a-9293-9dfc87a8357b tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:31.344198 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e99a99e3-51dc-480a-9293-9dfc87a8357b tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:31.345108 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e99a99e3-51dc-480a-9293-9dfc87a8357b tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:31.345644 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e99a99e3-51dc-480a-9293-9dfc87a8357b tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:31.708195 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-e99a99e3-51dc-480a-9293-9dfc87a8357b tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:31.727919 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-e99a99e3-51dc-480a-9293-9dfc87a8357b tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46" status: 200 len: 1577 microversion: 2.1 time: 0.409328 May 03 21:37:31.747939 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 578/1075] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:37:31 2022] GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46 => generated 1577 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:37:32.772900 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-22480b2d-9f5b-4592-9a44-c8b7d500c48b tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:32.773755 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-22480b2d-9f5b-4592-9a44-c8b7d500c48b tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 4e3930f0-3a9f-4d20-ae74-434e66c18c46] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:32.781950 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-22480b2d-9f5b-4592-9a44-c8b7d500c48b tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:32.782373 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-22480b2d-9f5b-4592-9a44-c8b7d500c48b tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:32.783159 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-22480b2d-9f5b-4592-9a44-c8b7d500c48b tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:32.783588 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-22480b2d-9f5b-4592-9a44-c8b7d500c48b tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:33.178497 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-22480b2d-9f5b-4592-9a44-c8b7d500c48b tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:33.198654 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-22480b2d-9f5b-4592-9a44-c8b7d500c48b tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46" status: 200 len: 1577 microversion: 2.1 time: 0.436477 May 03 21:37:33.202644 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 498/1076] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:37:32 2022] GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46 => generated 1577 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:37:34.228711 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-abebed41-bd69-4505-b672-1f3870091e24 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:34.230024 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-abebed41-bd69-4505-b672-1f3870091e24 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 4e3930f0-3a9f-4d20-ae74-434e66c18c46] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:34.241203 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-abebed41-bd69-4505-b672-1f3870091e24 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:34.241809 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-abebed41-bd69-4505-b672-1f3870091e24 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:34.242709 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-abebed41-bd69-4505-b672-1f3870091e24 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:34.243345 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-abebed41-bd69-4505-b672-1f3870091e24 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:34.515896 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-abebed41-bd69-4505-b672-1f3870091e24 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:34.536286 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-abebed41-bd69-4505-b672-1f3870091e24 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46" status: 200 len: 1577 microversion: 2.1 time: 0.321831 May 03 21:37:34.537178 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 579/1077] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:37:34 2022] GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46 => generated 1577 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:37:35.474082 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-b986d5b7-7e9a-43ca-91a3-ac3b393fe4c5 req-67682190-3e41-4684-a467-5dc4f9d2592c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e3930f0-3a9f-4d20-ae74-434e66c18c46", "name": "network-vif-deleted", "tag": "d3860f2c-7b5b-47b1-89e7-e6eac5582cd6"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:37:35.482284 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:37:35.482284 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:37:35.492589 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-b986d5b7-7e9a-43ca-91a3-ac3b393fe4c5 req-67682190-3e41-4684-a467-5dc4f9d2592c service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:35.493304 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-b986d5b7-7e9a-43ca-91a3-ac3b393fe4c5 req-67682190-3e41-4684-a467-5dc4f9d2592c service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:35.526576 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-b986d5b7-7e9a-43ca-91a3-ac3b393fe4c5 req-67682190-3e41-4684-a467-5dc4f9d2592c service nova] Creating event network-vif-deleted:d3860f2c-7b5b-47b1-89e7-e6eac5582cd6 for instance 4e3930f0-3a9f-4d20-ae74-434e66c18c46 on hv-cinder-84037 May 03 21:37:35.531806 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-b986d5b7-7e9a-43ca-91a3-ac3b393fe4c5 req-67682190-3e41-4684-a467-5dc4f9d2592c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069445 May 03 21:37:35.533240 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 499/1078] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:37:35.562515 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-dd156b37-e546-4faa-b30c-eb460f55cee8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:35.563819 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-dd156b37-e546-4faa-b30c-eb460f55cee8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 4e3930f0-3a9f-4d20-ae74-434e66c18c46] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:35.573361 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-dd156b37-e546-4faa-b30c-eb460f55cee8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:35.574181 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-dd156b37-e546-4faa-b30c-eb460f55cee8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:35.575297 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-dd156b37-e546-4faa-b30c-eb460f55cee8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:35.576280 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-dd156b37-e546-4faa-b30c-eb460f55cee8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:35.735444 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-dd156b37-e546-4faa-b30c-eb460f55cee8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:35.767681 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-dd156b37-e546-4faa-b30c-eb460f55cee8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46" status: 200 len: 1509 microversion: 2.1 time: 0.216956 May 03 21:37:35.768939 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 580/1079] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:37:35 2022] GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46 => generated 1509 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:37:36.793469 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-8eddb15a-d249-417a-98ba-7e362f4d3aba tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:36.794308 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-8eddb15a-d249-417a-98ba-7e362f4d3aba tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 4e3930f0-3a9f-4d20-ae74-434e66c18c46] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:36.803306 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8eddb15a-d249-417a-98ba-7e362f4d3aba tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:36.803847 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8eddb15a-d249-417a-98ba-7e362f4d3aba tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:36.804736 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8eddb15a-d249-417a-98ba-7e362f4d3aba tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:36.805178 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8eddb15a-d249-417a-98ba-7e362f4d3aba tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:36.891283 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8eddb15a-d249-417a-98ba-7e362f4d3aba tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:36.892030 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8eddb15a-d249-417a-98ba-7e362f4d3aba tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:36.893042 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.objects.instance [None req-8eddb15a-d249-417a-98ba-7e362f4d3aba tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lazy-loading 'fault' on Instance uuid 4e3930f0-3a9f-4d20-ae74-434e66c18c46 {{(pid=97831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 03 21:37:37.106282 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-8eddb15a-d249-417a-98ba-7e362f4d3aba tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:37.131609 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-8eddb15a-d249-417a-98ba-7e362f4d3aba tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46" status: 200 len: 1229 microversion: 2.1 time: 0.348870 May 03 21:37:37.132879 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 500/1080] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:37:36 2022] GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46 => generated 1229 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:37:38.155482 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-6bc05aad-9aca-4db9-b01d-9c0db03eb96d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:38.156105 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-6bc05aad-9aca-4db9-b01d-9c0db03eb96d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 4e3930f0-3a9f-4d20-ae74-434e66c18c46] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:38.167119 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6bc05aad-9aca-4db9-b01d-9c0db03eb96d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:38.167827 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6bc05aad-9aca-4db9-b01d-9c0db03eb96d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:38.168968 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6bc05aad-9aca-4db9-b01d-9c0db03eb96d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:38.169779 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-6bc05aad-9aca-4db9-b01d-9c0db03eb96d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:38.234862 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.wsgi [None req-6bc05aad-9aca-4db9-b01d-9c0db03eb96d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] HTTP exception thrown: Instance 4e3930f0-3a9f-4d20-ae74-434e66c18c46 could not be found. May 03 21:37:38.235475 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-6bc05aad-9aca-4db9-b01d-9c0db03eb96d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Returning 404 to user: Instance 4e3930f0-3a9f-4d20-ae74-434e66c18c46 could not be found. {{(pid=97832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:37:38.236315 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-6bc05aad-9aca-4db9-b01d-9c0db03eb96d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46" status: 404 len: 111 microversion: 2.1 time: 0.091674 May 03 21:37:38.237215 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 581/1081] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:37:38 2022] GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 21:37:38.361200 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-64c2b490-6f9b-40aa-bc42-411d8688f09e tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-209899544", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-103237313", "security_groups": [{"name": "tempest-secgroup-smoke-1580700779"}], "block_device_mapping_v2": [{"uuid": "5586d533-5d7b-478e-a810-2d5d0c485260", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f0a9fce1-0034-4c9f-bab5-3584af0c3657"}]}} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:37:38.537858 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.network.neutron [None req-64c2b490-6f9b-40aa-bc42-411d8688f09e tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] validate_networks() for [('f0a9fce1-0034-4c9f-bab5-3584af0c3657', None, None, None)] {{(pid=97831) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} May 03 21:37:39.243708 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-64c2b490-6f9b-40aa-bc42-411d8688f09e tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Flavor limits 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} May 03 21:37:39.244207 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-64c2b490-6f9b-40aa-bc42-411d8688f09e tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Image limits 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} May 03 21:37:39.245199 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-64c2b490-6f9b-40aa-bc42-411d8688f09e tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Flavor pref 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} May 03 21:37:39.245724 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-64c2b490-6f9b-40aa-bc42-411d8688f09e tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Image pref 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} May 03 21:37:39.246177 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-64c2b490-6f9b-40aa-bc42-411d8688f09e tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} May 03 21:37:39.255000 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-64c2b490-6f9b-40aa-bc42-411d8688f09e tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:39.255452 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-64c2b490-6f9b-40aa-bc42-411d8688f09e tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:39.256261 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-64c2b490-6f9b-40aa-bc42-411d8688f09e tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:39.256731 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-64c2b490-6f9b-40aa-bc42-411d8688f09e tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:39.283351 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-64c2b490-6f9b-40aa-bc42-411d8688f09e tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Getting quotas for project e665d5aad2c24ad7843ca060d41792d3. Resources: {'instances', 'ram', 'cores'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:37:39.287850 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-64c2b490-6f9b-40aa-bc42-411d8688f09e tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Getting quotas for user 2873b6c651a94d4992d0debcab8aeafd and project e665d5aad2c24ad7843ca060d41792d3. Resources: {'instances', 'ram', 'cores'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:37:39.413028 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-64c2b490-6f9b-40aa-bc42-411d8688f09e tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Going to run 1 instances... {{(pid=97831) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} May 03 21:37:39.416297 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-64c2b490-6f9b-40aa-bc42-411d8688f09e tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 5d20cd93-7f61-4f7b-9488-b8e8a56c24d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5586d533-5d7b-478e-a810-2d5d0c485260',volume_size=None,volume_type=None)] {{(pid=97831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} May 03 21:37:39.961708 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-64c2b490-6f9b-40aa-bc42-411d8688f09e tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.610860 May 03 21:37:39.962460 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 501/1082] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 3 21:37:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 1612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 03 21:37:39.982777 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-f479270f-b4a1-4699-bfbb-82cea8cb6945 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:39.983327 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-f479270f-b4a1-4699-bfbb-82cea8cb6945 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 5d20cd93-7f61-4f7b-9488-b8e8a56c24d8] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:40.076416 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-f479270f-b4a1-4699-bfbb-82cea8cb6945 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:40.087268 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-f479270f-b4a1-4699-bfbb-82cea8cb6945 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8" status: 200 len: 1093 microversion: 2.1 time: 0.117174 May 03 21:37:40.088850 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 582/1083] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:37:39 2022] GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8 => generated 1093 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:37:40.400264 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-afb9edbe-85d8-4a77-8c85-1001faa962d5 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1153214652", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1858174847", "security_groups": [{"name": "tempest-secgroup-smoke-1823248737"}], "networks": [{"uuid": "253db136-cbba-484c-ae24-75498a0c18e9"}], "block_device_mapping_v2": [{"uuid": "7f2df451-b8e9-429d-a976-de31c9d965d0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:37:40.691090 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.network.neutron [None req-afb9edbe-85d8-4a77-8c85-1001faa962d5 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] validate_networks() for [('253db136-cbba-484c-ae24-75498a0c18e9', None, None, None)] {{(pid=97831) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} May 03 21:37:41.112226 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-16583e2e-e731-4e32-9e46-ddac7f1ed151 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:41.112975 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-16583e2e-e731-4e32-9e46-ddac7f1ed151 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 5d20cd93-7f61-4f7b-9488-b8e8a56c24d8] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:41.123687 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-16583e2e-e731-4e32-9e46-ddac7f1ed151 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:41.124534 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-16583e2e-e731-4e32-9e46-ddac7f1ed151 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:41.126936 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-16583e2e-e731-4e32-9e46-ddac7f1ed151 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:41.126936 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-16583e2e-e731-4e32-9e46-ddac7f1ed151 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:41.261655 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-16583e2e-e731-4e32-9e46-ddac7f1ed151 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:41.271157 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-16583e2e-e731-4e32-9e46-ddac7f1ed151 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8" status: 200 len: 1143 microversion: 2.1 time: 0.169708 May 03 21:37:41.271681 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 583/1084] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:37:41 2022] GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8 => generated 1143 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:37:41.312817 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-afb9edbe-85d8-4a77-8c85-1001faa962d5 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Flavor limits 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} May 03 21:37:41.313266 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-afb9edbe-85d8-4a77-8c85-1001faa962d5 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Image limits 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} May 03 21:37:41.313712 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-afb9edbe-85d8-4a77-8c85-1001faa962d5 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Flavor pref 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} May 03 21:37:41.314128 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-afb9edbe-85d8-4a77-8c85-1001faa962d5 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Image pref 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} May 03 21:37:41.314579 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-afb9edbe-85d8-4a77-8c85-1001faa962d5 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} May 03 21:37:41.326926 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-afb9edbe-85d8-4a77-8c85-1001faa962d5 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:41.327373 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-afb9edbe-85d8-4a77-8c85-1001faa962d5 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:41.328165 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-afb9edbe-85d8-4a77-8c85-1001faa962d5 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:41.328646 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-afb9edbe-85d8-4a77-8c85-1001faa962d5 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:41.351548 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-afb9edbe-85d8-4a77-8c85-1001faa962d5 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Getting quotas for project eca9727df4a44eaaa12b84e3f0df0b51. Resources: {'instances', 'ram', 'cores'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:37:41.355819 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-afb9edbe-85d8-4a77-8c85-1001faa962d5 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Getting quotas for user bc7706b8821948b6bbfe86a3805f7461 and project eca9727df4a44eaaa12b84e3f0df0b51. Resources: {'instances', 'ram', 'cores'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:37:41.489715 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-afb9edbe-85d8-4a77-8c85-1001faa962d5 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Going to run 1 instances... {{(pid=97831) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} May 03 21:37:41.492107 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-afb9edbe-85d8-4a77-8c85-1001faa962d5 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7f2df451-b8e9-429d-a976-de31c9d965d0',volume_size=None,volume_type=None)] {{(pid=97831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} May 03 21:37:42.027790 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-afb9edbe-85d8-4a77-8c85-1001faa962d5 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.638509 May 03 21:37:42.028528 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 502/1085] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 3 21:37:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 1640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 03 21:37:42.044286 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-5b6acd16-09a6-4999-912d-07b5ab6934ef tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:42.044932 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-5b6acd16-09a6-4999-912d-07b5ab6934ef tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:42.223900 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-5b6acd16-09a6-4999-912d-07b5ab6934ef tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:42.250877 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-5b6acd16-09a6-4999-912d-07b5ab6934ef tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1089 microversion: 2.1 time: 0.216007 May 03 21:37:42.252166 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 584/1086] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:37:42 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1089 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:37:42.297808 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-9670bacc-32aa-4715-83b7-fab5b967da5e tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:42.298435 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-9670bacc-32aa-4715-83b7-fab5b967da5e tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 5d20cd93-7f61-4f7b-9488-b8e8a56c24d8] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:42.309528 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9670bacc-32aa-4715-83b7-fab5b967da5e tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:42.316394 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9670bacc-32aa-4715-83b7-fab5b967da5e tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:42.316394 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9670bacc-32aa-4715-83b7-fab5b967da5e tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:42.316394 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-9670bacc-32aa-4715-83b7-fab5b967da5e tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:42.504404 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-9670bacc-32aa-4715-83b7-fab5b967da5e tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:42.515881 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-9670bacc-32aa-4715-83b7-fab5b967da5e tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8" status: 200 len: 1191 microversion: 2.1 time: 0.230334 May 03 21:37:42.517147 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 503/1087] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:37:42 2022] GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8 => generated 1191 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:37:43.282468 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-00945251-7c5f-491f-a299-363104b406b4 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:43.283088 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-00945251-7c5f-491f-a299-363104b406b4 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:43.375202 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-00945251-7c5f-491f-a299-363104b406b4 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:43.384735 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-00945251-7c5f-491f-a299-363104b406b4 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1089 microversion: 2.1 time: 0.113291 May 03 21:37:43.386149 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 585/1088] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:37:43 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1089 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:37:43.539620 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-dfddac5d-b510-4943-8fc4-47594ec3e144 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:43.540295 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-dfddac5d-b510-4943-8fc4-47594ec3e144 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 5d20cd93-7f61-4f7b-9488-b8e8a56c24d8] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:43.548646 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-dfddac5d-b510-4943-8fc4-47594ec3e144 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:43.549101 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-dfddac5d-b510-4943-8fc4-47594ec3e144 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:43.550101 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-dfddac5d-b510-4943-8fc4-47594ec3e144 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:43.550719 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-dfddac5d-b510-4943-8fc4-47594ec3e144 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:43.695823 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-dfddac5d-b510-4943-8fc4-47594ec3e144 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:43.704176 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-dfddac5d-b510-4943-8fc4-47594ec3e144 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8" status: 200 len: 1209 microversion: 2.1 time: 0.174726 May 03 21:37:43.704760 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 504/1089] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:37:43 2022] GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8 => generated 1209 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:37:44.410711 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-4a23c741-9376-4bf5-b00f-39c65ce575b6 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:44.411325 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-4a23c741-9376-4bf5-b00f-39c65ce575b6 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:44.422277 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4a23c741-9376-4bf5-b00f-39c65ce575b6 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:44.423010 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4a23c741-9376-4bf5-b00f-39c65ce575b6 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:44.423956 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4a23c741-9376-4bf5-b00f-39c65ce575b6 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:44.424606 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-4a23c741-9376-4bf5-b00f-39c65ce575b6 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:44.609640 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-4a23c741-9376-4bf5-b00f-39c65ce575b6 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:44.620209 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-4a23c741-9376-4bf5-b00f-39c65ce575b6 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1187 microversion: 2.1 time: 0.220014 May 03 21:37:44.622126 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 586/1090] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:37:44 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1187 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:37:44.731866 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-05c045c2-20a6-494d-a64c-420f96016ea8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:44.732874 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-05c045c2-20a6-494d-a64c-420f96016ea8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 5d20cd93-7f61-4f7b-9488-b8e8a56c24d8] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:44.743825 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-05c045c2-20a6-494d-a64c-420f96016ea8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:44.745703 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-05c045c2-20a6-494d-a64c-420f96016ea8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:44.750968 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-05c045c2-20a6-494d-a64c-420f96016ea8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:44.751647 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-05c045c2-20a6-494d-a64c-420f96016ea8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:45.324488 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-05c045c2-20a6-494d-a64c-420f96016ea8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:45.347054 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-05c045c2-20a6-494d-a64c-420f96016ea8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8" status: 200 len: 1277 microversion: 2.1 time: 0.628455 May 03 21:37:45.348094 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 505/1091] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:37:44 2022] GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8 => generated 1277 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:37:45.643223 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-7186fdd7-ee7e-4390-99f7-84093040e4b2 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:45.643839 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-7186fdd7-ee7e-4390-99f7-84093040e4b2 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:45.653001 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7186fdd7-ee7e-4390-99f7-84093040e4b2 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:45.653718 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7186fdd7-ee7e-4390-99f7-84093040e4b2 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:45.654647 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7186fdd7-ee7e-4390-99f7-84093040e4b2 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:45.655229 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-7186fdd7-ee7e-4390-99f7-84093040e4b2 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:45.794251 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-7186fdd7-ee7e-4390-99f7-84093040e4b2 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:45.807325 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-7186fdd7-ee7e-4390-99f7-84093040e4b2 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1195 microversion: 2.1 time: 0.169069 May 03 21:37:45.807325 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 587/1092] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:37:45 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1195 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:37:45.980623 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-0cc1c341-397b-496e-8df6-1924489f006e req-5ea464b0-be45-4cea-b621-9ee8464d703b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d20cd93-7f61-4f7b-9488-b8e8a56c24d8", "tag": "861debb4-c679-41ef-af2d-3ffdd7122e86"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:37:45.988460 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:37:45.988460 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:37:46.009449 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-0cc1c341-397b-496e-8df6-1924489f006e req-5ea464b0-be45-4cea-b621-9ee8464d703b service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:46.010160 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-0cc1c341-397b-496e-8df6-1924489f006e req-5ea464b0-be45-4cea-b621-9ee8464d703b service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:46.033824 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-0cc1c341-397b-496e-8df6-1924489f006e req-5ea464b0-be45-4cea-b621-9ee8464d703b service nova] Creating event network-changed:861debb4-c679-41ef-af2d-3ffdd7122e86 for instance 5d20cd93-7f61-4f7b-9488-b8e8a56c24d8 on hv-cinder-84037 May 03 21:37:46.039661 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-0cc1c341-397b-496e-8df6-1924489f006e req-5ea464b0-be45-4cea-b621-9ee8464d703b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069666 May 03 21:37:46.040944 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 506/1093] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:37:46.375282 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-d70e0f4b-b767-4900-9a2d-c4cac9e6fab6 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:46.376136 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-d70e0f4b-b767-4900-9a2d-c4cac9e6fab6 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 5d20cd93-7f61-4f7b-9488-b8e8a56c24d8] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:46.384001 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d70e0f4b-b767-4900-9a2d-c4cac9e6fab6 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:46.384488 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d70e0f4b-b767-4900-9a2d-c4cac9e6fab6 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:46.385259 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d70e0f4b-b767-4900-9a2d-c4cac9e6fab6 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:46.385689 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d70e0f4b-b767-4900-9a2d-c4cac9e6fab6 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:46.622130 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-d70e0f4b-b767-4900-9a2d-c4cac9e6fab6 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:46.633294 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-d70e0f4b-b767-4900-9a2d-c4cac9e6fab6 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8" status: 200 len: 1265 microversion: 2.1 time: 0.267932 May 03 21:37:46.634047 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 588/1094] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:37:46 2022] GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8 => generated 1265 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:37:46.832631 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-6f69c2e0-f272-4d48-8819-c1e7c68c84ea tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:46.833389 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-6f69c2e0-f272-4d48-8819-c1e7c68c84ea tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:46.845153 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6f69c2e0-f272-4d48-8819-c1e7c68c84ea tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:46.845607 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6f69c2e0-f272-4d48-8819-c1e7c68c84ea tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:46.846434 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6f69c2e0-f272-4d48-8819-c1e7c68c84ea tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:46.846865 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6f69c2e0-f272-4d48-8819-c1e7c68c84ea tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:47.017798 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-6f69c2e0-f272-4d48-8819-c1e7c68c84ea tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:47.030073 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-6f69c2e0-f272-4d48-8819-c1e7c68c84ea tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1205 microversion: 2.1 time: 0.204623 May 03 21:37:47.030073 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 507/1095] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:37:46 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1205 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:37:47.656948 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-17cd58c1-3279-4776-8be6-6d09310268ac tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:47.658234 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-17cd58c1-3279-4776-8be6-6d09310268ac tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 5d20cd93-7f61-4f7b-9488-b8e8a56c24d8] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:47.667075 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-17cd58c1-3279-4776-8be6-6d09310268ac tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:47.668472 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-17cd58c1-3279-4776-8be6-6d09310268ac tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:47.669148 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-17cd58c1-3279-4776-8be6-6d09310268ac tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:47.669587 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-17cd58c1-3279-4776-8be6-6d09310268ac tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:47.892418 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-17cd58c1-3279-4776-8be6-6d09310268ac tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:47.901647 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-17cd58c1-3279-4776-8be6-6d09310268ac tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8" status: 200 len: 1265 microversion: 2.1 time: 0.254004 May 03 21:37:47.902053 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 589/1096] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:37:47 2022] GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8 => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:37:48.050844 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-e6a3fba1-cf3f-40cb-936d-322260fced49 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:48.051452 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-e6a3fba1-cf3f-40cb-936d-322260fced49 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:48.060116 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e6a3fba1-cf3f-40cb-936d-322260fced49 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:48.060611 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e6a3fba1-cf3f-40cb-936d-322260fced49 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:48.061407 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e6a3fba1-cf3f-40cb-936d-322260fced49 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:48.061966 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e6a3fba1-cf3f-40cb-936d-322260fced49 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:48.937324 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-a44884bf-2d67-49fa-bda9-c9d5dad02cf8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:48.938548 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-a44884bf-2d67-49fa-bda9-c9d5dad02cf8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 5d20cd93-7f61-4f7b-9488-b8e8a56c24d8] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:48.947079 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a44884bf-2d67-49fa-bda9-c9d5dad02cf8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:48.947780 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a44884bf-2d67-49fa-bda9-c9d5dad02cf8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:48.948786 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a44884bf-2d67-49fa-bda9-c9d5dad02cf8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:48.949375 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a44884bf-2d67-49fa-bda9-c9d5dad02cf8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:48.998139 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-e6a3fba1-cf3f-40cb-936d-322260fced49 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:49.013787 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-e6a3fba1-cf3f-40cb-936d-322260fced49 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1261 microversion: 2.1 time: 0.971873 May 03 21:37:49.014946 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 508/1097] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:37:48 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1261 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:37:49.237577 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-a44884bf-2d67-49fa-bda9-c9d5dad02cf8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:49.248025 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-a44884bf-2d67-49fa-bda9-c9d5dad02cf8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8" status: 200 len: 1265 microversion: 2.1 time: 0.323356 May 03 21:37:49.249219 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 590/1098] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:37:48 2022] GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8 => generated 1265 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:37:49.606206 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-524c92d6-ae0e-43f4-a929-3f3af784dc97 req-d4d012e8-5a15-4adf-8c73-1662e3163fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f20570e8-6f8e-4837-9fe7-10002cea7cea", "tag": "b0b6b891-8700-4c78-8b4a-550162963c94"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:37:49.613800 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:37:49.613800 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:37:49.623493 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-524c92d6-ae0e-43f4-a929-3f3af784dc97 req-d4d012e8-5a15-4adf-8c73-1662e3163fe6 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:49.624039 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-524c92d6-ae0e-43f4-a929-3f3af784dc97 req-d4d012e8-5a15-4adf-8c73-1662e3163fe6 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:49.643622 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-524c92d6-ae0e-43f4-a929-3f3af784dc97 req-d4d012e8-5a15-4adf-8c73-1662e3163fe6 service nova] Creating event network-changed:b0b6b891-8700-4c78-8b4a-550162963c94 for instance f20570e8-6f8e-4837-9fe7-10002cea7cea on hv-cinder-84037 May 03 21:37:49.649153 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-524c92d6-ae0e-43f4-a929-3f3af784dc97 req-d4d012e8-5a15-4adf-8c73-1662e3163fe6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054968 May 03 21:37:49.649757 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 509/1099] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:37:50.038659 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-283c850f-6e83-4de2-b793-d168f32a1c02 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:50.039354 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-283c850f-6e83-4de2-b793-d168f32a1c02 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:50.046953 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-283c850f-6e83-4de2-b793-d168f32a1c02 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:50.047394 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-283c850f-6e83-4de2-b793-d168f32a1c02 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:50.048170 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-283c850f-6e83-4de2-b793-d168f32a1c02 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:50.048645 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-283c850f-6e83-4de2-b793-d168f32a1c02 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:50.274067 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-991f4883-15f9-41cc-9477-1110106d76f7 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:50.274789 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-991f4883-15f9-41cc-9477-1110106d76f7 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 5d20cd93-7f61-4f7b-9488-b8e8a56c24d8] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:50.283769 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-991f4883-15f9-41cc-9477-1110106d76f7 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:50.284228 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-991f4883-15f9-41cc-9477-1110106d76f7 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:50.285045 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-991f4883-15f9-41cc-9477-1110106d76f7 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:50.285744 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-991f4883-15f9-41cc-9477-1110106d76f7 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:50.321704 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-283c850f-6e83-4de2-b793-d168f32a1c02 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:50.333539 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-283c850f-6e83-4de2-b793-d168f32a1c02 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1261 microversion: 2.1 time: 0.304405 May 03 21:37:50.334747 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 591/1100] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:37:50 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1261 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:37:50.723229 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-991f4883-15f9-41cc-9477-1110106d76f7 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:50.732861 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-991f4883-15f9-41cc-9477-1110106d76f7 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8" status: 200 len: 1265 microversion: 2.1 time: 0.469940 May 03 21:37:50.733411 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 510/1101] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:37:50 2022] GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8 => generated 1265 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:37:51.358427 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-0b9e0bbf-2cf3-4c89-bdf0-774b6a02e914 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:51.359052 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-0b9e0bbf-2cf3-4c89-bdf0-774b6a02e914 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:51.367858 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0b9e0bbf-2cf3-4c89-bdf0-774b6a02e914 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:51.368304 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0b9e0bbf-2cf3-4c89-bdf0-774b6a02e914 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:51.369107 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0b9e0bbf-2cf3-4c89-bdf0-774b6a02e914 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:51.369797 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0b9e0bbf-2cf3-4c89-bdf0-774b6a02e914 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:51.588193 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-0b9e0bbf-2cf3-4c89-bdf0-774b6a02e914 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:51.596236 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-0b9e0bbf-2cf3-4c89-bdf0-774b6a02e914 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1261 microversion: 2.1 time: 0.247534 May 03 21:37:51.596801 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 592/1102] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:37:51 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1261 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:37:51.755362 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-405e821a-7237-4611-9be4-67ae4643b4f8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:51.756038 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-405e821a-7237-4611-9be4-67ae4643b4f8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 5d20cd93-7f61-4f7b-9488-b8e8a56c24d8] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:51.764265 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-405e821a-7237-4611-9be4-67ae4643b4f8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:51.764757 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-405e821a-7237-4611-9be4-67ae4643b4f8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:51.765545 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-405e821a-7237-4611-9be4-67ae4643b4f8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:51.765978 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-405e821a-7237-4611-9be4-67ae4643b4f8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:52.044013 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-405e821a-7237-4611-9be4-67ae4643b4f8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:52.052964 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-405e821a-7237-4611-9be4-67ae4643b4f8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8" status: 200 len: 1265 microversion: 2.1 time: 0.306456 May 03 21:37:52.053427 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 511/1103] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:37:51 2022] GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8 => generated 1265 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:37:52.620126 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-9f58086e-20ec-4e9e-aad7-bac09bb8ae1f tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:52.620720 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-9f58086e-20ec-4e9e-aad7-bac09bb8ae1f tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:52.627890 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9f58086e-20ec-4e9e-aad7-bac09bb8ae1f tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:52.628338 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9f58086e-20ec-4e9e-aad7-bac09bb8ae1f tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:52.629140 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9f58086e-20ec-4e9e-aad7-bac09bb8ae1f tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:52.629570 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9f58086e-20ec-4e9e-aad7-bac09bb8ae1f tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:52.887636 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-9f58086e-20ec-4e9e-aad7-bac09bb8ae1f tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:52.892436 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-9f58086e-20ec-4e9e-aad7-bac09bb8ae1f tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1261 microversion: 2.1 time: 0.282273 May 03 21:37:52.893226 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 593/1104] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:37:52 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1261 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:37:53.075965 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-0d750f87-75f5-4e61-bf85-bbbcdb410936 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:53.076922 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-0d750f87-75f5-4e61-bf85-bbbcdb410936 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 5d20cd93-7f61-4f7b-9488-b8e8a56c24d8] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:53.086100 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0d750f87-75f5-4e61-bf85-bbbcdb410936 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:53.086545 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0d750f87-75f5-4e61-bf85-bbbcdb410936 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:53.091734 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0d750f87-75f5-4e61-bf85-bbbcdb410936 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:53.091734 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-0d750f87-75f5-4e61-bf85-bbbcdb410936 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:53.310901 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-0d750f87-75f5-4e61-bf85-bbbcdb410936 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:53.319632 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-0d750f87-75f5-4e61-bf85-bbbcdb410936 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8" status: 200 len: 1265 microversion: 2.1 time: 0.253378 May 03 21:37:53.320174 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 512/1105] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:37:53 2022] GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8 => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:37:53.915482 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-5ea9b798-6ca0-4f86-846a-24407d155263 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:53.916074 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-5ea9b798-6ca0-4f86-846a-24407d155263 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:53.924194 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5ea9b798-6ca0-4f86-846a-24407d155263 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:53.924840 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5ea9b798-6ca0-4f86-846a-24407d155263 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:53.925738 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5ea9b798-6ca0-4f86-846a-24407d155263 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:53.926164 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-5ea9b798-6ca0-4f86-846a-24407d155263 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:54.165316 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-5ea9b798-6ca0-4f86-846a-24407d155263 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:54.173674 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-5ea9b798-6ca0-4f86-846a-24407d155263 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1261 microversion: 2.1 time: 0.267811 May 03 21:37:54.174265 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 594/1106] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:37:53 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1261 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:37:54.345370 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-392da190-b614-4317-8b33-ac4cbbdc95ca tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:54.345964 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-392da190-b614-4317-8b33-ac4cbbdc95ca tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 5d20cd93-7f61-4f7b-9488-b8e8a56c24d8] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:54.353394 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-392da190-b614-4317-8b33-ac4cbbdc95ca tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:54.353899 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-392da190-b614-4317-8b33-ac4cbbdc95ca tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:54.354615 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-392da190-b614-4317-8b33-ac4cbbdc95ca tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:54.355052 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-392da190-b614-4317-8b33-ac4cbbdc95ca tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:54.582551 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-392da190-b614-4317-8b33-ac4cbbdc95ca tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:54.606898 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-392da190-b614-4317-8b33-ac4cbbdc95ca tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8" status: 200 len: 1265 microversion: 2.1 time: 0.256242 May 03 21:37:54.606898 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 513/1107] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:37:54 2022] GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8 => generated 1265 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:37:55.198143 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-2db2471f-1651-4bb7-89d6-66f96ae65092 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:55.198788 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-2db2471f-1651-4bb7-89d6-66f96ae65092 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:55.205870 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2db2471f-1651-4bb7-89d6-66f96ae65092 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:55.206318 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2db2471f-1651-4bb7-89d6-66f96ae65092 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:55.207083 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2db2471f-1651-4bb7-89d6-66f96ae65092 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:55.207511 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-2db2471f-1651-4bb7-89d6-66f96ae65092 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:55.420283 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-2db2471f-1651-4bb7-89d6-66f96ae65092 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:55.430406 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-2db2471f-1651-4bb7-89d6-66f96ae65092 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1261 microversion: 2.1 time: 0.241103 May 03 21:37:55.431069 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 595/1108] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:37:55 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1261 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:37:55.622453 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-d92e9e1c-3ec1-428e-a7ad-da1216a1b6d4 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:55.623454 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-d92e9e1c-3ec1-428e-a7ad-da1216a1b6d4 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 5d20cd93-7f61-4f7b-9488-b8e8a56c24d8] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:55.630377 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d92e9e1c-3ec1-428e-a7ad-da1216a1b6d4 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:55.630842 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d92e9e1c-3ec1-428e-a7ad-da1216a1b6d4 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:55.632333 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d92e9e1c-3ec1-428e-a7ad-da1216a1b6d4 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:55.633085 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-d92e9e1c-3ec1-428e-a7ad-da1216a1b6d4 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:55.856418 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-d92e9e1c-3ec1-428e-a7ad-da1216a1b6d4 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:55.864954 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-d92e9e1c-3ec1-428e-a7ad-da1216a1b6d4 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8" status: 200 len: 1265 microversion: 2.1 time: 0.258882 May 03 21:37:55.866850 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 514/1109] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:37:55 2022] GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8 => generated 1265 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:37:56.452983 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-54ad2d4f-825c-4bbf-b050-6c0c6843b227 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:56.453605 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-54ad2d4f-825c-4bbf-b050-6c0c6843b227 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:56.462359 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-54ad2d4f-825c-4bbf-b050-6c0c6843b227 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:56.462969 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-54ad2d4f-825c-4bbf-b050-6c0c6843b227 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:56.464468 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-54ad2d4f-825c-4bbf-b050-6c0c6843b227 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:56.464973 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-54ad2d4f-825c-4bbf-b050-6c0c6843b227 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:56.681990 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-54ad2d4f-825c-4bbf-b050-6c0c6843b227 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:56.690305 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-54ad2d4f-825c-4bbf-b050-6c0c6843b227 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1261 microversion: 2.1 time: 0.247032 May 03 21:37:56.690845 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 596/1110] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:37:56 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1261 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:37:56.889469 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-1bb43860-c15d-4fe9-9a72-c731b0eb86f1 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:56.890092 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-1bb43860-c15d-4fe9-9a72-c731b0eb86f1 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 5d20cd93-7f61-4f7b-9488-b8e8a56c24d8] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:56.898391 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1bb43860-c15d-4fe9-9a72-c731b0eb86f1 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:56.899375 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1bb43860-c15d-4fe9-9a72-c731b0eb86f1 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:56.907674 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1bb43860-c15d-4fe9-9a72-c731b0eb86f1 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:56.907674 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1bb43860-c15d-4fe9-9a72-c731b0eb86f1 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:57.114427 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-1bb43860-c15d-4fe9-9a72-c731b0eb86f1 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:57.124593 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-1bb43860-c15d-4fe9-9a72-c731b0eb86f1 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8" status: 200 len: 1265 microversion: 2.1 time: 0.245048 May 03 21:37:57.125133 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 515/1111] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:37:56 2022] GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8 => generated 1265 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:37:57.714298 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-55c8293e-5188-4779-9200-54122212ae90 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:57.724243 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-55c8293e-5188-4779-9200-54122212ae90 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:57.724243 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-55c8293e-5188-4779-9200-54122212ae90 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:57.724243 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-55c8293e-5188-4779-9200-54122212ae90 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:57.724243 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-55c8293e-5188-4779-9200-54122212ae90 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:57.724693 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-55c8293e-5188-4779-9200-54122212ae90 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:57.948267 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-13f7e5ff-4843-4c8e-99c6-edf073ac493f req-b2abb36d-0342-41ce-a69a-5fca176c476f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d20cd93-7f61-4f7b-9488-b8e8a56c24d8", "name": "network-vif-plugged", "status": "completed", "tag": "861debb4-c679-41ef-af2d-3ffdd7122e86"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:37:57.955710 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:37:57.955710 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:37:57.967215 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-55c8293e-5188-4779-9200-54122212ae90 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:57.969904 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-13f7e5ff-4843-4c8e-99c6-edf073ac493f req-b2abb36d-0342-41ce-a69a-5fca176c476f service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:57.970488 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-13f7e5ff-4843-4c8e-99c6-edf073ac493f req-b2abb36d-0342-41ce-a69a-5fca176c476f service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:57.977956 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-55c8293e-5188-4779-9200-54122212ae90 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1261 microversion: 2.1 time: 0.274450 May 03 21:37:57.979076 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 597/1112] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:37:57 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1261 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:37:57.997904 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-13f7e5ff-4843-4c8e-99c6-edf073ac493f req-b2abb36d-0342-41ce-a69a-5fca176c476f service nova] Creating event network-vif-plugged:861debb4-c679-41ef-af2d-3ffdd7122e86 for instance 5d20cd93-7f61-4f7b-9488-b8e8a56c24d8 on hv-cinder-84037 May 03 21:37:58.002880 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-13f7e5ff-4843-4c8e-99c6-edf073ac493f req-b2abb36d-0342-41ce-a69a-5fca176c476f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065366 May 03 21:37:58.003465 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 516/1113] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:37:58.148015 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-50aeeb51-134e-4990-8d50-1c10449c5a6d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:58.148661 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-50aeeb51-134e-4990-8d50-1c10449c5a6d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 5d20cd93-7f61-4f7b-9488-b8e8a56c24d8] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:58.156060 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-50aeeb51-134e-4990-8d50-1c10449c5a6d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:58.156543 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-50aeeb51-134e-4990-8d50-1c10449c5a6d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:58.157310 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-50aeeb51-134e-4990-8d50-1c10449c5a6d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:58.157785 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-50aeeb51-134e-4990-8d50-1c10449c5a6d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:58.401859 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-50aeeb51-134e-4990-8d50-1c10449c5a6d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:58.414491 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-50aeeb51-134e-4990-8d50-1c10449c5a6d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8" status: 200 len: 1265 microversion: 2.1 time: 0.275794 May 03 21:37:58.423774 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 598/1114] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:37:58 2022] GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8 => generated 1265 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:37:59.002155 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-ac410c5e-7a23-4a1b-9965-bb695a2bad33 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:59.002855 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-ac410c5e-7a23-4a1b-9965-bb695a2bad33 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:59.011785 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ac410c5e-7a23-4a1b-9965-bb695a2bad33 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:59.014753 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ac410c5e-7a23-4a1b-9965-bb695a2bad33 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:59.014753 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ac410c5e-7a23-4a1b-9965-bb695a2bad33 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:59.014753 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ac410c5e-7a23-4a1b-9965-bb695a2bad33 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:59.264871 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-ac410c5e-7a23-4a1b-9965-bb695a2bad33 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:59.274269 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-ac410c5e-7a23-4a1b-9965-bb695a2bad33 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1261 microversion: 2.1 time: 0.283377 May 03 21:37:59.274817 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 517/1115] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:37:58 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1261 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:37:59.436649 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-55790149-cf23-435a-9fb1-20bdfa7dfc36 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:37:59.437201 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-55790149-cf23-435a-9fb1-20bdfa7dfc36 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 5d20cd93-7f61-4f7b-9488-b8e8a56c24d8] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:37:59.444844 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-55790149-cf23-435a-9fb1-20bdfa7dfc36 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:59.445296 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-55790149-cf23-435a-9fb1-20bdfa7dfc36 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:59.446088 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-55790149-cf23-435a-9fb1-20bdfa7dfc36 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:37:59.446519 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-55790149-cf23-435a-9fb1-20bdfa7dfc36 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:37:59.717770 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-55790149-cf23-435a-9fb1-20bdfa7dfc36 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:37:59.727047 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-55790149-cf23-435a-9fb1-20bdfa7dfc36 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8" status: 200 len: 1265 microversion: 2.1 time: 0.300140 May 03 21:37:59.727591 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 599/1116] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:37:59 2022] GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8 => generated 1265 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:38:00.304887 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-7581e184-3f47-4248-bd03-99ea71f098df tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:38:00.305708 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-7581e184-3f47-4248-bd03-99ea71f098df tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:38:00.313629 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7581e184-3f47-4248-bd03-99ea71f098df tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:38:00.314000 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7581e184-3f47-4248-bd03-99ea71f098df tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:38:00.314829 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7581e184-3f47-4248-bd03-99ea71f098df tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:38:00.315275 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7581e184-3f47-4248-bd03-99ea71f098df tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:38:00.556098 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-7581e184-3f47-4248-bd03-99ea71f098df tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:38:00.564635 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-7581e184-3f47-4248-bd03-99ea71f098df tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1261 microversion: 2.1 time: 0.277117 May 03 21:38:00.565306 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 518/1117] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:38:00 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1261 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:38:00.751147 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-90476337-8886-4716-991f-f84179528b98 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:38:00.752040 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-90476337-8886-4716-991f-f84179528b98 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 5d20cd93-7f61-4f7b-9488-b8e8a56c24d8] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:38:00.760513 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-90476337-8886-4716-991f-f84179528b98 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:38:00.760910 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-90476337-8886-4716-991f-f84179528b98 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:38:00.761770 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-90476337-8886-4716-991f-f84179528b98 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:38:00.762155 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-90476337-8886-4716-991f-f84179528b98 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:38:00.983229 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-90476337-8886-4716-991f-f84179528b98 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:38:00.992414 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-90476337-8886-4716-991f-f84179528b98 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8" status: 200 len: 1453 microversion: 2.1 time: 0.251667 May 03 21:38:00.992988 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 600/1118] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:38:00 2022] GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8 => generated 1453 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:38:01.019987 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-2205bb96-f862-43ab-bf39-4f5e8ef1b927 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:38:01.019987 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-2205bb96-f862-43ab-bf39-4f5e8ef1b927 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 5d20cd93-7f61-4f7b-9488-b8e8a56c24d8] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:38:01.023531 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2205bb96-f862-43ab-bf39-4f5e8ef1b927 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:38:01.023929 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2205bb96-f862-43ab-bf39-4f5e8ef1b927 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:38:01.024812 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2205bb96-f862-43ab-bf39-4f5e8ef1b927 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:38:01.025177 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2205bb96-f862-43ab-bf39-4f5e8ef1b927 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:38:01.240539 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-2205bb96-f862-43ab-bf39-4f5e8ef1b927 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:38:01.249734 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-2205bb96-f862-43ab-bf39-4f5e8ef1b927 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8" status: 200 len: 1453 microversion: 2.1 time: 0.244977 May 03 21:38:01.250288 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 519/1119] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:38:01 2022] GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8 => generated 1453 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:38:01.591236 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-fdcec0bf-72c7-4d1c-8312-dddf4badcc75 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:38:01.591871 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-fdcec0bf-72c7-4d1c-8312-dddf4badcc75 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:38:01.603593 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fdcec0bf-72c7-4d1c-8312-dddf4badcc75 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:38:01.604375 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fdcec0bf-72c7-4d1c-8312-dddf4badcc75 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:38:01.605786 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fdcec0bf-72c7-4d1c-8312-dddf4badcc75 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:38:01.606424 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fdcec0bf-72c7-4d1c-8312-dddf4badcc75 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:38:01.959452 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-17f1e9cd-ed15-4a5d-99ad-b2cbd63e049b req-e0ba7e4f-bf8f-4574-bb47-c92f2a4554cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f20570e8-6f8e-4837-9fe7-10002cea7cea", "name": "network-vif-plugged", "status": "completed", "tag": "b0b6b891-8700-4c78-8b4a-550162963c94"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:38:01.966214 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:38:01.966214 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:38:01.975579 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-17f1e9cd-ed15-4a5d-99ad-b2cbd63e049b req-e0ba7e4f-bf8f-4574-bb47-c92f2a4554cd service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:38:01.982907 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-17f1e9cd-ed15-4a5d-99ad-b2cbd63e049b req-e0ba7e4f-bf8f-4574-bb47-c92f2a4554cd service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:38:01.993977 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-17f1e9cd-ed15-4a5d-99ad-b2cbd63e049b req-e0ba7e4f-bf8f-4574-bb47-c92f2a4554cd service nova] Creating event network-vif-plugged:b0b6b891-8700-4c78-8b4a-550162963c94 for instance f20570e8-6f8e-4837-9fe7-10002cea7cea on hv-cinder-84037 May 03 21:38:01.999421 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-17f1e9cd-ed15-4a5d-99ad-b2cbd63e049b req-e0ba7e4f-bf8f-4574-bb47-c92f2a4554cd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048531 May 03 21:38:02.000496 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 520/1120] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:38:02.099234 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-fdcec0bf-72c7-4d1c-8312-dddf4badcc75 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:38:02.113298 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-fdcec0bf-72c7-4d1c-8312-dddf4badcc75 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1261 microversion: 2.1 time: 0.533768 May 03 21:38:02.138243 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 601/1121] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:38:01 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1261 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:38:03.153981 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-933b2006-7dfb-4c6e-9a53-12ee94965a2b tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:38:03.154850 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-933b2006-7dfb-4c6e-9a53-12ee94965a2b tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:38:03.163221 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-933b2006-7dfb-4c6e-9a53-12ee94965a2b tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:38:03.163894 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-933b2006-7dfb-4c6e-9a53-12ee94965a2b tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:38:03.164859 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-933b2006-7dfb-4c6e-9a53-12ee94965a2b tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:38:03.165397 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-933b2006-7dfb-4c6e-9a53-12ee94965a2b tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:38:03.484455 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-933b2006-7dfb-4c6e-9a53-12ee94965a2b tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:38:03.509736 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-933b2006-7dfb-4c6e-9a53-12ee94965a2b tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1261 microversion: 2.1 time: 0.368419 May 03 21:38:03.511089 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 521/1122] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:38:03 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1261 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:38:04.539524 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-a6f568ca-d22a-40b2-9c3a-d83fcbcff962 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:38:04.540401 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-a6f568ca-d22a-40b2-9c3a-d83fcbcff962 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:38:04.552598 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a6f568ca-d22a-40b2-9c3a-d83fcbcff962 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:38:04.552598 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a6f568ca-d22a-40b2-9c3a-d83fcbcff962 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:38:04.552598 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a6f568ca-d22a-40b2-9c3a-d83fcbcff962 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:38:04.552598 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-a6f568ca-d22a-40b2-9c3a-d83fcbcff962 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:38:04.880651 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-dcf86ff9-a914-406e-9d2c-3997cc845a93 req-e1dcbdd3-df30-4b92-8b97-bfefa5dccbcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d20cd93-7f61-4f7b-9488-b8e8a56c24d8", "tag": "861debb4-c679-41ef-af2d-3ffdd7122e86"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:38:04.889056 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:38:04.889056 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:38:04.898949 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-dcf86ff9-a914-406e-9d2c-3997cc845a93 req-e1dcbdd3-df30-4b92-8b97-bfefa5dccbcf service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:38:04.899718 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-dcf86ff9-a914-406e-9d2c-3997cc845a93 req-e1dcbdd3-df30-4b92-8b97-bfefa5dccbcf service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:38:04.923224 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-dcf86ff9-a914-406e-9d2c-3997cc845a93 req-e1dcbdd3-df30-4b92-8b97-bfefa5dccbcf service nova] Creating event network-changed:861debb4-c679-41ef-af2d-3ffdd7122e86 for instance 5d20cd93-7f61-4f7b-9488-b8e8a56c24d8 on hv-cinder-84037 May 03 21:38:04.929971 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-dcf86ff9-a914-406e-9d2c-3997cc845a93 req-e1dcbdd3-df30-4b92-8b97-bfefa5dccbcf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058946 May 03 21:38:04.931034 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 522/1123] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:38:04.981946 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-a6f568ca-d22a-40b2-9c3a-d83fcbcff962 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:38:04.991387 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-a6f568ca-d22a-40b2-9c3a-d83fcbcff962 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1446 microversion: 2.1 time: 0.467083 May 03 21:38:04.994808 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 602/1124] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:38:04 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1446 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:38:05.019920 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-a8241913-16de-4a4c-b401-7c9efb6e3f84 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:38:05.020833 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-a8241913-16de-4a4c-b401-7c9efb6e3f84 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:38:05.029964 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a8241913-16de-4a4c-b401-7c9efb6e3f84 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:38:05.033643 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a8241913-16de-4a4c-b401-7c9efb6e3f84 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:38:05.033643 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a8241913-16de-4a4c-b401-7c9efb6e3f84 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:38:05.033643 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a8241913-16de-4a4c-b401-7c9efb6e3f84 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:38:05.567805 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-a8241913-16de-4a4c-b401-7c9efb6e3f84 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:38:05.581503 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-a8241913-16de-4a4c-b401-7c9efb6e3f84 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1446 microversion: 2.1 time: 0.572731 May 03 21:38:05.582092 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 523/1125] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:38:05 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1446 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:38:09.489251 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-ca1dc1f7-c4ce-4fc8-9cab-f0cba5140e3a req-9caa781b-d8c7-4211-b632-cbe23621ecf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f20570e8-6f8e-4837-9fe7-10002cea7cea", "tag": "b0b6b891-8700-4c78-8b4a-550162963c94"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:38:09.499487 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:38:09.499487 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:38:09.509106 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-ca1dc1f7-c4ce-4fc8-9cab-f0cba5140e3a req-9caa781b-d8c7-4211-b632-cbe23621ecf5 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:38:09.509554 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-ca1dc1f7-c4ce-4fc8-9cab-f0cba5140e3a req-9caa781b-d8c7-4211-b632-cbe23621ecf5 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:38:09.526579 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-ca1dc1f7-c4ce-4fc8-9cab-f0cba5140e3a req-9caa781b-d8c7-4211-b632-cbe23621ecf5 service nova] Creating event network-changed:b0b6b891-8700-4c78-8b4a-550162963c94 for instance f20570e8-6f8e-4837-9fe7-10002cea7cea on hv-cinder-84037 May 03 21:38:09.531790 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-ca1dc1f7-c4ce-4fc8-9cab-f0cba5140e3a req-9caa781b-d8c7-4211-b632-cbe23621ecf5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058907 May 03 21:38:09.533002 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 603/1126] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:39:52.527813 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-b74d3a5a-3e12-457d-9568-7b4f36e24b59 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1095603412", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-103237313", "security_groups": [{"name": "tempest-secgroup-smoke-1580700779"}], "block_device_mapping_v2": [{"uuid": "e1cbea81-f287-4586-a896-287b4af5dd78", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f0a9fce1-0034-4c9f-bab5-3584af0c3657"}]}} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:39:52.558204 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7b33f1a3-64dc-4501-919f-e660fca3730c] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 03 21:39:52.559128 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection May 03 21:39:52.559304 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: Tue May 3 21:39:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! May 03 21:39:52.570293 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 21:39:52.570509 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: Tue May 3 21:39:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! May 03 21:39:52.924341 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.network.neutron [None req-b74d3a5a-3e12-457d-9568-7b4f36e24b59 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] validate_networks() for [('f0a9fce1-0034-4c9f-bab5-3584af0c3657', None, None, None)] {{(pid=97831) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} May 03 21:39:53.576587 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO oslo.messaging._drivers.impl_rabbit [-] [7b33f1a3-64dc-4501-919f-e660fca3730c] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 38510. May 03 21:39:53.600193 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-b74d3a5a-3e12-457d-9568-7b4f36e24b59 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Flavor limits 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} May 03 21:39:53.600648 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-b74d3a5a-3e12-457d-9568-7b4f36e24b59 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Image limits 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} May 03 21:39:53.601161 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-b74d3a5a-3e12-457d-9568-7b4f36e24b59 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Flavor pref 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} May 03 21:39:53.601558 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-b74d3a5a-3e12-457d-9568-7b4f36e24b59 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Image pref 0:0:0 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} May 03 21:39:53.601967 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.virt.hardware [None req-b74d3a5a-3e12-457d-9568-7b4f36e24b59 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} May 03 21:39:53.610582 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b74d3a5a-3e12-457d-9568-7b4f36e24b59 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:39:53.611028 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b74d3a5a-3e12-457d-9568-7b4f36e24b59 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:39:53.611826 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b74d3a5a-3e12-457d-9568-7b4f36e24b59 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:39:53.612260 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b74d3a5a-3e12-457d-9568-7b4f36e24b59 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:39:53.630569 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-b74d3a5a-3e12-457d-9568-7b4f36e24b59 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Getting quotas for project e665d5aad2c24ad7843ca060d41792d3. Resources: {'instances', 'ram', 'cores'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 03 21:39:53.634603 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.quota [None req-b74d3a5a-3e12-457d-9568-7b4f36e24b59 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Getting quotas for user 2873b6c651a94d4992d0debcab8aeafd and project e665d5aad2c24ad7843ca060d41792d3. Resources: {'instances', 'ram', 'cores'} {{(pid=97831) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 03 21:39:53.727722 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-b74d3a5a-3e12-457d-9568-7b4f36e24b59 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Going to run 1 instances... {{(pid=97831) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} May 03 21:39:53.730022 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-b74d3a5a-3e12-457d-9568-7b4f36e24b59 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: cea317da-5aeb-47d0-a20a-17f516ce9eb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e1cbea81-f287-4586-a896-287b4af5dd78',volume_size=None,volume_type=None)] {{(pid=97831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} May 03 21:39:54.233192 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-b74d3a5a-3e12-457d-9568-7b4f36e24b59 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.714801 May 03 21:39:54.234921 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 524/1127] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 3 21:39:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 1717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 03 21:39:54.242376 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 03 21:39:54.243213 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: Tue May 3 21:39:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4 (ip 10.222.0.48) !!! May 03 21:39:54.256127 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection May 03 21:39:54.256307 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: Tue May 3 21:39:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4 (ip 10.222.0.48) !!! May 03 21:39:54.268284 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: ERROR oslo.messaging._drivers.impl_rabbit [-] [03323b56-2538-48fa-9f4b-dc7c22c57cde] AMQP server on 10.222.0.48:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 03 21:39:54.280129 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-e949065e-b735-4884-9230-dd065888f240 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:39:54.280860 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-e949065e-b735-4884-9230-dd065888f240 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: cea317da-5aeb-47d0-a20a-17f516ce9eb4] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:39:54.459995 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-e949065e-b735-4884-9230-dd065888f240 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:39:54.468160 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-e949065e-b735-4884-9230-dd065888f240 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4" status: 200 len: 1094 microversion: 2.1 time: 0.227101 May 03 21:39:54.468745 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 604/1128] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:39:54 2022] GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4 => generated 1094 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:39:55.491553 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-bd251d64-85d4-4d0a-b521-71a2ae44ca78 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:39:55.492189 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-bd251d64-85d4-4d0a-b521-71a2ae44ca78 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: cea317da-5aeb-47d0-a20a-17f516ce9eb4] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:39:55.589535 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-bd251d64-85d4-4d0a-b521-71a2ae44ca78 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:39:55.597289 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-bd251d64-85d4-4d0a-b521-71a2ae44ca78 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4" status: 200 len: 1094 microversion: 2.1 time: 0.115256 May 03 21:39:55.597936 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 525/1129] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:39:55 2022] GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4 => generated 1094 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:39:56.621258 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-2fc96df6-30ff-406b-9b57-881ccbe37a25 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:39:56.621883 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-2fc96df6-30ff-406b-9b57-881ccbe37a25 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: cea317da-5aeb-47d0-a20a-17f516ce9eb4] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:39:56.661817 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO oslo.messaging._drivers.impl_rabbit [-] [03323b56-2538-48fa-9f4b-dc7c22c57cde] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 38542. May 03 21:39:56.714244 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-2fc96df6-30ff-406b-9b57-881ccbe37a25 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:39:56.722554 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-2fc96df6-30ff-406b-9b57-881ccbe37a25 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4" status: 200 len: 1094 microversion: 2.1 time: 0.111448 May 03 21:39:56.723132 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 605/1130] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:39:56 2022] GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4 => generated 1094 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:39:57.745371 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-581c54f5-aa59-454d-a251-93e048d3d161 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:39:57.745980 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-581c54f5-aa59-454d-a251-93e048d3d161 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: cea317da-5aeb-47d0-a20a-17f516ce9eb4] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:39:57.822777 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-581c54f5-aa59-454d-a251-93e048d3d161 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:39:57.831743 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-581c54f5-aa59-454d-a251-93e048d3d161 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4" status: 200 len: 1094 microversion: 2.1 time: 0.096022 May 03 21:39:57.832307 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 526/1131] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:39:57 2022] GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4 => generated 1094 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:39:58.854539 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-8a05cd7e-5834-4a8c-b811-5444d63e9a55 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:39:58.855173 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-8a05cd7e-5834-4a8c-b811-5444d63e9a55 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: cea317da-5aeb-47d0-a20a-17f516ce9eb4] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:39:58.862845 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8a05cd7e-5834-4a8c-b811-5444d63e9a55 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:39:58.863306 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8a05cd7e-5834-4a8c-b811-5444d63e9a55 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:39:58.864233 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8a05cd7e-5834-4a8c-b811-5444d63e9a55 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:39:58.864683 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-8a05cd7e-5834-4a8c-b811-5444d63e9a55 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:39:58.986618 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-8a05cd7e-5834-4a8c-b811-5444d63e9a55 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:39:58.995573 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-8a05cd7e-5834-4a8c-b811-5444d63e9a55 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4" status: 200 len: 1144 microversion: 2.1 time: 0.149601 May 03 21:39:58.996135 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 606/1132] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:39:58 2022] GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4 => generated 1144 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:00.017791 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-8f594692-8b63-41aa-82c4-61509cca4d73 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:00.018477 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-8f594692-8b63-41aa-82c4-61509cca4d73 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: cea317da-5aeb-47d0-a20a-17f516ce9eb4] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:00.025964 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8f594692-8b63-41aa-82c4-61509cca4d73 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:00.026523 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8f594692-8b63-41aa-82c4-61509cca4d73 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:00.027425 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8f594692-8b63-41aa-82c4-61509cca4d73 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:00.027867 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8f594692-8b63-41aa-82c4-61509cca4d73 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:00.159066 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-8f594692-8b63-41aa-82c4-61509cca4d73 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:00.167654 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-8f594692-8b63-41aa-82c4-61509cca4d73 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4" status: 200 len: 1192 microversion: 2.1 time: 0.158968 May 03 21:40:00.168196 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 527/1133] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:00 2022] GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4 => generated 1192 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:01.190374 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-fc42ec67-d0f1-42f6-900a-f8709496dfed tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:01.191227 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-fc42ec67-d0f1-42f6-900a-f8709496dfed tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: cea317da-5aeb-47d0-a20a-17f516ce9eb4] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:01.199265 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fc42ec67-d0f1-42f6-900a-f8709496dfed tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:01.199634 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fc42ec67-d0f1-42f6-900a-f8709496dfed tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:01.200471 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fc42ec67-d0f1-42f6-900a-f8709496dfed tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:01.200915 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fc42ec67-d0f1-42f6-900a-f8709496dfed tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:01.336607 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-fc42ec67-d0f1-42f6-900a-f8709496dfed tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:01.345688 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-fc42ec67-d0f1-42f6-900a-f8709496dfed tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4" status: 200 len: 1210 microversion: 2.1 time: 0.165397 May 03 21:40:01.346374 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 607/1134] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:01 2022] GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4 => generated 1210 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:02.371570 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-54794da3-f9b9-4c05-833b-ce7a261f918d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:02.372251 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-54794da3-f9b9-4c05-833b-ce7a261f918d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: cea317da-5aeb-47d0-a20a-17f516ce9eb4] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:02.379602 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-54794da3-f9b9-4c05-833b-ce7a261f918d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:02.380058 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-54794da3-f9b9-4c05-833b-ce7a261f918d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:02.380868 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-54794da3-f9b9-4c05-833b-ce7a261f918d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:02.381299 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-54794da3-f9b9-4c05-833b-ce7a261f918d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:02.865789 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-54794da3-f9b9-4c05-833b-ce7a261f918d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:02.878929 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-54794da3-f9b9-4c05-833b-ce7a261f918d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4" status: 200 len: 1278 microversion: 2.1 time: 0.517837 May 03 21:40:02.879798 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 528/1135] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:02 2022] GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4 => generated 1278 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:03.276000 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-1628e0ae-701d-4f5e-8376-3dab3ec9d032 req-8e6a4eab-6c9e-4017-9c51-b4e75bb7e076 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cea317da-5aeb-47d0-a20a-17f516ce9eb4", "tag": "863dbad0-54f3-4bbe-8e38-c7eb9fe7f31b"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:40:03.283018 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:40:03.283018 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:40:03.292370 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-1628e0ae-701d-4f5e-8376-3dab3ec9d032 req-8e6a4eab-6c9e-4017-9c51-b4e75bb7e076 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:03.292924 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-1628e0ae-701d-4f5e-8376-3dab3ec9d032 req-8e6a4eab-6c9e-4017-9c51-b4e75bb7e076 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:03.313728 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-1628e0ae-701d-4f5e-8376-3dab3ec9d032 req-8e6a4eab-6c9e-4017-9c51-b4e75bb7e076 service nova] Creating event network-changed:863dbad0-54f3-4bbe-8e38-c7eb9fe7f31b for instance cea317da-5aeb-47d0-a20a-17f516ce9eb4 on hv-cinder-84037 May 03 21:40:03.318703 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-1628e0ae-701d-4f5e-8376-3dab3ec9d032 req-8e6a4eab-6c9e-4017-9c51-b4e75bb7e076 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134610 May 03 21:40:03.320502 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 608/1136] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:40:03.908897 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-2c99e59f-cb77-4702-8aed-298b926fdff0 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:03.909424 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-2c99e59f-cb77-4702-8aed-298b926fdff0 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: cea317da-5aeb-47d0-a20a-17f516ce9eb4] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:03.917035 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2c99e59f-cb77-4702-8aed-298b926fdff0 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:03.917756 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2c99e59f-cb77-4702-8aed-298b926fdff0 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:03.918548 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2c99e59f-cb77-4702-8aed-298b926fdff0 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:03.918981 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-2c99e59f-cb77-4702-8aed-298b926fdff0 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:04.158169 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-2c99e59f-cb77-4702-8aed-298b926fdff0 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:04.169152 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-2c99e59f-cb77-4702-8aed-298b926fdff0 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4" status: 200 len: 1266 microversion: 2.1 time: 0.270298 May 03 21:40:04.169613 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 529/1137] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:03 2022] GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4 => generated 1266 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:05.192628 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-96d50aa5-a21a-46db-8c1d-596e46ef2145 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:05.193325 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-96d50aa5-a21a-46db-8c1d-596e46ef2145 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: cea317da-5aeb-47d0-a20a-17f516ce9eb4] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:05.202142 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-96d50aa5-a21a-46db-8c1d-596e46ef2145 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:05.202583 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-96d50aa5-a21a-46db-8c1d-596e46ef2145 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:05.203353 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-96d50aa5-a21a-46db-8c1d-596e46ef2145 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:05.203843 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-96d50aa5-a21a-46db-8c1d-596e46ef2145 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:05.412129 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-96d50aa5-a21a-46db-8c1d-596e46ef2145 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:05.420794 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-96d50aa5-a21a-46db-8c1d-596e46ef2145 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4" status: 200 len: 1266 microversion: 2.1 time: 0.237644 May 03 21:40:05.421348 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 609/1138] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:05 2022] GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4 => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:40:06.444312 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-8d1dff2a-d3a8-4af5-9a1e-af67f4fad713 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:06.445190 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-8d1dff2a-d3a8-4af5-9a1e-af67f4fad713 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: cea317da-5aeb-47d0-a20a-17f516ce9eb4] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:06.453463 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8d1dff2a-d3a8-4af5-9a1e-af67f4fad713 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:06.453910 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8d1dff2a-d3a8-4af5-9a1e-af67f4fad713 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:06.454675 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8d1dff2a-d3a8-4af5-9a1e-af67f4fad713 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:06.455244 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-8d1dff2a-d3a8-4af5-9a1e-af67f4fad713 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:06.667078 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-8d1dff2a-d3a8-4af5-9a1e-af67f4fad713 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:06.675414 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-8d1dff2a-d3a8-4af5-9a1e-af67f4fad713 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4" status: 200 len: 1266 microversion: 2.1 time: 0.241112 May 03 21:40:06.675959 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 530/1139] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:06 2022] GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4 => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:07.698777 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-58f62d7f-b8d5-425e-946e-093a5d57999d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:07.699396 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-58f62d7f-b8d5-425e-946e-093a5d57999d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: cea317da-5aeb-47d0-a20a-17f516ce9eb4] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:07.706724 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-58f62d7f-b8d5-425e-946e-093a5d57999d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:07.707169 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-58f62d7f-b8d5-425e-946e-093a5d57999d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:07.707935 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-58f62d7f-b8d5-425e-946e-093a5d57999d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:07.708366 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-58f62d7f-b8d5-425e-946e-093a5d57999d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:07.928211 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-58f62d7f-b8d5-425e-946e-093a5d57999d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:07.937218 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-58f62d7f-b8d5-425e-946e-093a5d57999d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4" status: 200 len: 1266 microversion: 2.1 time: 0.247742 May 03 21:40:07.937760 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 610/1140] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:07 2022] GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4 => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:08.960713 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-4e68a80e-2774-45d1-bb69-60f9076540be tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:08.961433 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-4e68a80e-2774-45d1-bb69-60f9076540be tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: cea317da-5aeb-47d0-a20a-17f516ce9eb4] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:08.969984 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4e68a80e-2774-45d1-bb69-60f9076540be tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:08.970435 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4e68a80e-2774-45d1-bb69-60f9076540be tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:08.971217 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4e68a80e-2774-45d1-bb69-60f9076540be tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:08.971650 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4e68a80e-2774-45d1-bb69-60f9076540be tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:09.245661 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-4e68a80e-2774-45d1-bb69-60f9076540be tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:09.255046 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-4e68a80e-2774-45d1-bb69-60f9076540be tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4" status: 200 len: 1266 microversion: 2.1 time: 0.303688 May 03 21:40:09.255619 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 531/1141] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:08 2022] GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4 => generated 1266 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:10.282272 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-0ebc887d-80a0-4599-93e5-9d83cb15bf1d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:10.282897 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-0ebc887d-80a0-4599-93e5-9d83cb15bf1d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: cea317da-5aeb-47d0-a20a-17f516ce9eb4] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:10.290586 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0ebc887d-80a0-4599-93e5-9d83cb15bf1d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:10.291060 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0ebc887d-80a0-4599-93e5-9d83cb15bf1d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:10.291969 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0ebc887d-80a0-4599-93e5-9d83cb15bf1d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:10.292397 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-0ebc887d-80a0-4599-93e5-9d83cb15bf1d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:10.511067 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-0ebc887d-80a0-4599-93e5-9d83cb15bf1d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:10.519401 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-0ebc887d-80a0-4599-93e5-9d83cb15bf1d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4" status: 200 len: 1266 microversion: 2.1 time: 0.246165 May 03 21:40:10.520082 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 611/1142] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:10 2022] GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4 => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:11.544586 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-5c7f57fc-5267-4b97-b081-5b53d81fdb76 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:11.545228 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-5c7f57fc-5267-4b97-b081-5b53d81fdb76 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: cea317da-5aeb-47d0-a20a-17f516ce9eb4] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:11.552716 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5c7f57fc-5267-4b97-b081-5b53d81fdb76 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:11.553169 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5c7f57fc-5267-4b97-b081-5b53d81fdb76 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:11.553943 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5c7f57fc-5267-4b97-b081-5b53d81fdb76 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:11.554375 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-5c7f57fc-5267-4b97-b081-5b53d81fdb76 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:11.764652 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-5c7f57fc-5267-4b97-b081-5b53d81fdb76 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:11.772972 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-5c7f57fc-5267-4b97-b081-5b53d81fdb76 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4" status: 200 len: 1266 microversion: 2.1 time: 0.237775 May 03 21:40:11.773521 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 532/1143] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:11 2022] GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4 => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:12.795413 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-57efdd5c-5d4b-415d-9c46-72c344a2fcd4 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:12.795974 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-57efdd5c-5d4b-415d-9c46-72c344a2fcd4 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: cea317da-5aeb-47d0-a20a-17f516ce9eb4] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:12.803232 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-57efdd5c-5d4b-415d-9c46-72c344a2fcd4 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:12.803680 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-57efdd5c-5d4b-415d-9c46-72c344a2fcd4 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:12.804468 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-57efdd5c-5d4b-415d-9c46-72c344a2fcd4 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:12.804905 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-57efdd5c-5d4b-415d-9c46-72c344a2fcd4 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:13.014683 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-57efdd5c-5d4b-415d-9c46-72c344a2fcd4 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:13.023268 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-57efdd5c-5d4b-415d-9c46-72c344a2fcd4 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4" status: 200 len: 1266 microversion: 2.1 time: 0.237058 May 03 21:40:13.023821 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 612/1144] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:12 2022] GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4 => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:14.047411 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-e7916a5b-cbe1-468c-936a-824ed5341ee8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:14.048106 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-e7916a5b-cbe1-468c-936a-824ed5341ee8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: cea317da-5aeb-47d0-a20a-17f516ce9eb4] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:14.056448 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e7916a5b-cbe1-468c-936a-824ed5341ee8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:14.057191 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e7916a5b-cbe1-468c-936a-824ed5341ee8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:14.058073 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e7916a5b-cbe1-468c-936a-824ed5341ee8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:14.058805 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-e7916a5b-cbe1-468c-936a-824ed5341ee8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:14.277599 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-e7916a5b-cbe1-468c-936a-824ed5341ee8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:14.286155 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-e7916a5b-cbe1-468c-936a-824ed5341ee8 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4" status: 200 len: 1266 microversion: 2.1 time: 0.248876 May 03 21:40:14.287247 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 533/1145] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:14 2022] GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4 => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:14.655529 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-c3c5831f-3e1d-4242-af6b-44e30e0e7077 req-c802d677-a7f7-422c-90f2-378f71d79cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cea317da-5aeb-47d0-a20a-17f516ce9eb4", "name": "network-vif-plugged", "status": "completed", "tag": "863dbad0-54f3-4bbe-8e38-c7eb9fe7f31b"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:40:14.661886 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:40:14.661886 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:40:14.671758 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-c3c5831f-3e1d-4242-af6b-44e30e0e7077 req-c802d677-a7f7-422c-90f2-378f71d79cc3 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:14.672928 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-c3c5831f-3e1d-4242-af6b-44e30e0e7077 req-c802d677-a7f7-422c-90f2-378f71d79cc3 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:14.692460 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-c3c5831f-3e1d-4242-af6b-44e30e0e7077 req-c802d677-a7f7-422c-90f2-378f71d79cc3 service nova] Creating event network-vif-plugged:863dbad0-54f3-4bbe-8e38-c7eb9fe7f31b for instance cea317da-5aeb-47d0-a20a-17f516ce9eb4 on hv-cinder-84037 May 03 21:40:14.698229 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-c3c5831f-3e1d-4242-af6b-44e30e0e7077 req-c802d677-a7f7-422c-90f2-378f71d79cc3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132606 May 03 21:40:14.698840 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 613/1146] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:40:15.309537 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-de65374f-5cde-425d-9c0d-796471e5776c tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:15.310158 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-de65374f-5cde-425d-9c0d-796471e5776c tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: cea317da-5aeb-47d0-a20a-17f516ce9eb4] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:15.318176 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-de65374f-5cde-425d-9c0d-796471e5776c tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:15.318616 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-de65374f-5cde-425d-9c0d-796471e5776c tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:15.319383 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-de65374f-5cde-425d-9c0d-796471e5776c tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:15.319810 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-de65374f-5cde-425d-9c0d-796471e5776c tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:15.474580 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-eeef12dd-5f98-46bd-9b44-32cd8295530f tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:40:15.475222 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-eeef12dd-5f98-46bd-9b44-32cd8295530f tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:15.484308 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-eeef12dd-5f98-46bd-9b44-32cd8295530f tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:15.484787 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-eeef12dd-5f98-46bd-9b44-32cd8295530f tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:15.485567 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-eeef12dd-5f98-46bd-9b44-32cd8295530f tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:15.485997 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-eeef12dd-5f98-46bd-9b44-32cd8295530f tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:15.531000 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-de65374f-5cde-425d-9c0d-796471e5776c tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:15.539658 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-de65374f-5cde-425d-9c0d-796471e5776c tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4" status: 200 len: 1266 microversion: 2.1 time: 0.239767 May 03 21:40:15.540261 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 534/1147] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:15 2022] GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4 => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:15.548850 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.objects.instance [None req-eeef12dd-5f98-46bd-9b44-32cd8295530f tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lazy-loading 'flavor' on Instance uuid f20570e8-6f8e-4837-9fe7-10002cea7cea {{(pid=97832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 03 21:40:15.913207 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-eeef12dd-5f98-46bd-9b44-32cd8295530f tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "POST /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea/action" status: 202 len: 0 microversion: 2.1 time: 0.448151 May 03 21:40:15.914187 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 614/1148] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 3 21:40:15 2022] POST /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea/action => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 03 21:40:15.936312 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-a994238f-6817-4be4-8cd3-0ee2cc91a897 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:15.936964 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-a994238f-6817-4be4-8cd3-0ee2cc91a897 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:15.944832 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a994238f-6817-4be4-8cd3-0ee2cc91a897 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:15.945327 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a994238f-6817-4be4-8cd3-0ee2cc91a897 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:15.952404 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a994238f-6817-4be4-8cd3-0ee2cc91a897 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:15.952404 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a994238f-6817-4be4-8cd3-0ee2cc91a897 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:16.253514 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-a994238f-6817-4be4-8cd3-0ee2cc91a897 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:16.263992 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-a994238f-6817-4be4-8cd3-0ee2cc91a897 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1570 microversion: 2.1 time: 0.337068 May 03 21:40:16.268482 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 535/1149] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:15 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1570 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:16.569857 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-3b165cd0-3ca4-46e1-87ec-b64dae8f4d4d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:16.570591 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-3b165cd0-3ca4-46e1-87ec-b64dae8f4d4d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: cea317da-5aeb-47d0-a20a-17f516ce9eb4] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:16.584360 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3b165cd0-3ca4-46e1-87ec-b64dae8f4d4d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:16.584853 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3b165cd0-3ca4-46e1-87ec-b64dae8f4d4d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:16.585627 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3b165cd0-3ca4-46e1-87ec-b64dae8f4d4d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:16.586060 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-3b165cd0-3ca4-46e1-87ec-b64dae8f4d4d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:16.798463 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-3b165cd0-3ca4-46e1-87ec-b64dae8f4d4d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:16.807123 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-3b165cd0-3ca4-46e1-87ec-b64dae8f4d4d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4" status: 200 len: 1453 microversion: 2.1 time: 0.252729 May 03 21:40:16.807658 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 615/1150] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:16 2022] GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4 => generated 1453 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:16.828306 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-6bf1f4d4-5a04-46c3-a564-dcb989f3a621 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:16.828951 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-6bf1f4d4-5a04-46c3-a564-dcb989f3a621 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: cea317da-5aeb-47d0-a20a-17f516ce9eb4] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:16.836193 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6bf1f4d4-5a04-46c3-a564-dcb989f3a621 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:16.836691 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6bf1f4d4-5a04-46c3-a564-dcb989f3a621 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:16.838030 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6bf1f4d4-5a04-46c3-a564-dcb989f3a621 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:16.838476 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-6bf1f4d4-5a04-46c3-a564-dcb989f3a621 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:17.209968 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-6bf1f4d4-5a04-46c3-a564-dcb989f3a621 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:17.219128 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-6bf1f4d4-5a04-46c3-a564-dcb989f3a621 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4" status: 200 len: 1453 microversion: 2.1 time: 0.400091 May 03 21:40:17.219666 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 536/1151] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:16 2022] GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4 => generated 1453 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:17.288291 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-fd0293a8-79a3-49ae-8304-f403e94fd7d9 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:17.288948 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-fd0293a8-79a3-49ae-8304-f403e94fd7d9 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:17.296608 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fd0293a8-79a3-49ae-8304-f403e94fd7d9 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:17.297056 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fd0293a8-79a3-49ae-8304-f403e94fd7d9 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:17.297819 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fd0293a8-79a3-49ae-8304-f403e94fd7d9 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:17.298242 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fd0293a8-79a3-49ae-8304-f403e94fd7d9 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:17.698635 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-fd0293a8-79a3-49ae-8304-f403e94fd7d9 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:17.706944 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-fd0293a8-79a3-49ae-8304-f403e94fd7d9 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1570 microversion: 2.1 time: 0.428522 May 03 21:40:17.707492 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 616/1152] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:17 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1570 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:40:18.730518 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-29330309-31f2-44f6-9d8e-589c75c6176a tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:18.731155 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-29330309-31f2-44f6-9d8e-589c75c6176a tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:18.748256 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-29330309-31f2-44f6-9d8e-589c75c6176a tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:18.748745 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-29330309-31f2-44f6-9d8e-589c75c6176a tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:18.749537 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-29330309-31f2-44f6-9d8e-589c75c6176a tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:18.749982 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-29330309-31f2-44f6-9d8e-589c75c6176a tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:18.977652 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-29330309-31f2-44f6-9d8e-589c75c6176a tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:18.988224 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-29330309-31f2-44f6-9d8e-589c75c6176a tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1570 microversion: 2.1 time: 0.266833 May 03 21:40:18.991242 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 537/1153] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:18 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1570 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:20.013903 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-d7c82beb-e3f4-48f3-b737-a55d023ab24d tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:20.014661 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-d7c82beb-e3f4-48f3-b737-a55d023ab24d tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:20.022504 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d7c82beb-e3f4-48f3-b737-a55d023ab24d tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:20.022949 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d7c82beb-e3f4-48f3-b737-a55d023ab24d tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:20.023764 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d7c82beb-e3f4-48f3-b737-a55d023ab24d tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:20.024171 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-d7c82beb-e3f4-48f3-b737-a55d023ab24d tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:20.275599 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-d7c82beb-e3f4-48f3-b737-a55d023ab24d tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:20.285267 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-d7c82beb-e3f4-48f3-b737-a55d023ab24d tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1570 microversion: 2.1 time: 0.281358 May 03 21:40:20.286170 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 617/1154] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:20 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1570 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:20.545917 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-60bb4307-d240-494f-8528-6a6f42fca252 req-c07d5a29-cb2f-4299-bdbe-8698bf64ae69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cea317da-5aeb-47d0-a20a-17f516ce9eb4", "tag": "863dbad0-54f3-4bbe-8e38-c7eb9fe7f31b"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:40:20.553027 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:40:20.553027 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:40:20.561569 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-60bb4307-d240-494f-8528-6a6f42fca252 req-c07d5a29-cb2f-4299-bdbe-8698bf64ae69 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:20.562007 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-60bb4307-d240-494f-8528-6a6f42fca252 req-c07d5a29-cb2f-4299-bdbe-8698bf64ae69 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:20.579188 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-60bb4307-d240-494f-8528-6a6f42fca252 req-c07d5a29-cb2f-4299-bdbe-8698bf64ae69 service nova] Creating event network-changed:863dbad0-54f3-4bbe-8e38-c7eb9fe7f31b for instance cea317da-5aeb-47d0-a20a-17f516ce9eb4 on hv-cinder-84037 May 03 21:40:20.584394 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-60bb4307-d240-494f-8528-6a6f42fca252 req-c07d5a29-cb2f-4299-bdbe-8698bf64ae69 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129919 May 03 21:40:20.585425 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 538/1155] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:40:21.310628 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-baf78adf-2137-4bcc-a3fd-b2bf4548e00c tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:21.311265 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-baf78adf-2137-4bcc-a3fd-b2bf4548e00c tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:21.318723 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-baf78adf-2137-4bcc-a3fd-b2bf4548e00c tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:21.319167 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-baf78adf-2137-4bcc-a3fd-b2bf4548e00c tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:21.319929 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-baf78adf-2137-4bcc-a3fd-b2bf4548e00c tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:21.320358 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-baf78adf-2137-4bcc-a3fd-b2bf4548e00c tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:21.540319 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-baf78adf-2137-4bcc-a3fd-b2bf4548e00c tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:21.548981 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-baf78adf-2137-4bcc-a3fd-b2bf4548e00c tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1570 microversion: 2.1 time: 0.249548 May 03 21:40:21.549526 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 618/1156] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:21 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1570 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:22.574298 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-4b6d8c82-37d5-457d-a282-d73aca7523d1 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:22.575004 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-4b6d8c82-37d5-457d-a282-d73aca7523d1 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:22.582739 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4b6d8c82-37d5-457d-a282-d73aca7523d1 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:22.583334 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4b6d8c82-37d5-457d-a282-d73aca7523d1 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:22.584116 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4b6d8c82-37d5-457d-a282-d73aca7523d1 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:22.584585 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4b6d8c82-37d5-457d-a282-d73aca7523d1 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:22.797680 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-4b6d8c82-37d5-457d-a282-d73aca7523d1 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:22.806167 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-4b6d8c82-37d5-457d-a282-d73aca7523d1 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1570 microversion: 2.1 time: 0.242069 May 03 21:40:22.806890 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 539/1157] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:22 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1570 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:23.829276 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-293e50b7-f092-4eb3-9f67-2dbe8989a8d1 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:23.829963 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-293e50b7-f092-4eb3-9f67-2dbe8989a8d1 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:23.837340 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-293e50b7-f092-4eb3-9f67-2dbe8989a8d1 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:23.838085 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-293e50b7-f092-4eb3-9f67-2dbe8989a8d1 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:23.838671 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-293e50b7-f092-4eb3-9f67-2dbe8989a8d1 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:23.839101 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-293e50b7-f092-4eb3-9f67-2dbe8989a8d1 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:24.047735 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-293e50b7-f092-4eb3-9f67-2dbe8989a8d1 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:24.056850 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-293e50b7-f092-4eb3-9f67-2dbe8989a8d1 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1570 microversion: 2.1 time: 0.236660 May 03 21:40:24.057318 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 619/1158] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:23 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1570 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:25.079819 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-39e69b7d-e4c4-4edf-a0bc-20cd7542ec26 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:25.080418 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-39e69b7d-e4c4-4edf-a0bc-20cd7542ec26 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:25.088810 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-39e69b7d-e4c4-4edf-a0bc-20cd7542ec26 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:25.089266 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-39e69b7d-e4c4-4edf-a0bc-20cd7542ec26 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:25.090045 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-39e69b7d-e4c4-4edf-a0bc-20cd7542ec26 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:25.090477 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-39e69b7d-e4c4-4edf-a0bc-20cd7542ec26 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:25.298642 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-39e69b7d-e4c4-4edf-a0bc-20cd7542ec26 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:25.307609 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-39e69b7d-e4c4-4edf-a0bc-20cd7542ec26 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1570 microversion: 2.1 time: 0.237384 May 03 21:40:25.308137 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 540/1159] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:25 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1570 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:26.330666 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-fb040d94-41b8-4783-b030-d98f7c467ebc tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:26.331269 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-fb040d94-41b8-4783-b030-d98f7c467ebc tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:26.339188 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fb040d94-41b8-4783-b030-d98f7c467ebc tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:26.339629 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fb040d94-41b8-4783-b030-d98f7c467ebc tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:26.340384 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fb040d94-41b8-4783-b030-d98f7c467ebc tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:26.340840 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fb040d94-41b8-4783-b030-d98f7c467ebc tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:26.563878 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-fb040d94-41b8-4783-b030-d98f7c467ebc tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:26.572948 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-fb040d94-41b8-4783-b030-d98f7c467ebc tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1570 microversion: 2.1 time: 0.251804 May 03 21:40:26.574007 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 620/1160] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:26 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1570 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:27.596547 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-62a6dc57-4a84-43d8-8bb3-8fc32bde8d46 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:27.597169 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-62a6dc57-4a84-43d8-8bb3-8fc32bde8d46 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:27.605065 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-62a6dc57-4a84-43d8-8bb3-8fc32bde8d46 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:27.605529 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-62a6dc57-4a84-43d8-8bb3-8fc32bde8d46 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:27.606313 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-62a6dc57-4a84-43d8-8bb3-8fc32bde8d46 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:27.606748 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-62a6dc57-4a84-43d8-8bb3-8fc32bde8d46 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:27.813640 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-62a6dc57-4a84-43d8-8bb3-8fc32bde8d46 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:27.821779 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-62a6dc57-4a84-43d8-8bb3-8fc32bde8d46 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1570 microversion: 2.1 time: 0.234485 May 03 21:40:27.822325 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 541/1161] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:27 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1570 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:28.844464 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-f546bc88-3eea-4593-97da-1f38c5ebebe7 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:28.845068 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-f546bc88-3eea-4593-97da-1f38c5ebebe7 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:28.852156 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f546bc88-3eea-4593-97da-1f38c5ebebe7 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:28.852634 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f546bc88-3eea-4593-97da-1f38c5ebebe7 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:28.853398 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f546bc88-3eea-4593-97da-1f38c5ebebe7 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:28.853821 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-f546bc88-3eea-4593-97da-1f38c5ebebe7 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:29.060954 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-f546bc88-3eea-4593-97da-1f38c5ebebe7 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:29.071101 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-f546bc88-3eea-4593-97da-1f38c5ebebe7 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1570 microversion: 2.1 time: 0.235861 May 03 21:40:29.072046 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 621/1162] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:28 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1570 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:30.098344 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-7b425f48-f555-428c-9e6d-a676ada1585c tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:30.098927 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-7b425f48-f555-428c-9e6d-a676ada1585c tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:30.106542 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7b425f48-f555-428c-9e6d-a676ada1585c tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:30.107004 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7b425f48-f555-428c-9e6d-a676ada1585c tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:30.107847 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7b425f48-f555-428c-9e6d-a676ada1585c tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:30.108356 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-7b425f48-f555-428c-9e6d-a676ada1585c tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:30.317018 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-7b425f48-f555-428c-9e6d-a676ada1585c tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:30.326063 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-7b425f48-f555-428c-9e6d-a676ada1585c tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1571 microversion: 2.1 time: 0.238349 May 03 21:40:30.326590 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 542/1163] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:30 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1571 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:30.347670 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-ca28199a-2268-4a1f-93b7-497f8f71b110 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:40:30.348240 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-ca28199a-2268-4a1f-93b7-497f8f71b110 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:30.355436 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ca28199a-2268-4a1f-93b7-497f8f71b110 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:30.355863 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ca28199a-2268-4a1f-93b7-497f8f71b110 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:30.357287 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ca28199a-2268-4a1f-93b7-497f8f71b110 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:30.357718 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-ca28199a-2268-4a1f-93b7-497f8f71b110 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:30.829284 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-ca28199a-2268-4a1f-93b7-497f8f71b110 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "POST /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea/action" status: 202 len: 0 microversion: 2.1 time: 0.490938 May 03 21:40:30.830114 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 622/1164] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 3 21:40:30 2022] POST /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea/action => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 03 21:40:30.843766 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-150c5a41-06fa-4aa3-81a4-314b54ebb64b tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:30.844415 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-150c5a41-06fa-4aa3-81a4-314b54ebb64b tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:30.851562 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-150c5a41-06fa-4aa3-81a4-314b54ebb64b tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:30.852025 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-150c5a41-06fa-4aa3-81a4-314b54ebb64b tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:30.852835 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-150c5a41-06fa-4aa3-81a4-314b54ebb64b tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:30.853266 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-150c5a41-06fa-4aa3-81a4-314b54ebb64b tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:31.176832 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-150c5a41-06fa-4aa3-81a4-314b54ebb64b tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:31.191779 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-150c5a41-06fa-4aa3-81a4-314b54ebb64b tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1519 microversion: 2.1 time: 0.357579 May 03 21:40:31.192656 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 543/1165] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:30 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1519 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:32.214259 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-77e6b326-d633-46c9-ad34-802e88b4b5a3 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:32.214785 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-77e6b326-d633-46c9-ad34-802e88b4b5a3 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:32.222625 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-77e6b326-d633-46c9-ad34-802e88b4b5a3 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:32.223085 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-77e6b326-d633-46c9-ad34-802e88b4b5a3 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:32.223853 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-77e6b326-d633-46c9-ad34-802e88b4b5a3 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:32.224282 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-77e6b326-d633-46c9-ad34-802e88b4b5a3 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:32.435592 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-77e6b326-d633-46c9-ad34-802e88b4b5a3 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:32.443980 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-77e6b326-d633-46c9-ad34-802e88b4b5a3 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1521 microversion: 2.1 time: 0.238895 May 03 21:40:32.444585 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 623/1166] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:32 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:32.537157 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-7c6af8a1-ea34-4103-84a7-278265f681bf req-8fc91e45-3a31-4ba8-91d5-b68ac9d584e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f20570e8-6f8e-4837-9fe7-10002cea7cea", "name": "network-vif-unplugged", "status": "completed", "tag": "b0b6b891-8700-4c78-8b4a-550162963c94"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:40:32.544035 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:40:32.544035 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:40:32.552471 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-7c6af8a1-ea34-4103-84a7-278265f681bf req-8fc91e45-3a31-4ba8-91d5-b68ac9d584e5 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:32.552922 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-7c6af8a1-ea34-4103-84a7-278265f681bf req-8fc91e45-3a31-4ba8-91d5-b68ac9d584e5 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:32.568768 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.compute.server_external_events [req-7c6af8a1-ea34-4103-84a7-278265f681bf req-8fc91e45-3a31-4ba8-91d5-b68ac9d584e5 service nova] Unable to find a host for instance f20570e8-6f8e-4837-9fe7-10002cea7cea. Dropping event network-vif-unplugged {{(pid=97831) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} May 03 21:40:32.570209 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-7c6af8a1-ea34-4103-84a7-278265f681bf req-8fc91e45-3a31-4ba8-91d5-b68ac9d584e5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.042503 May 03 21:40:32.570209 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 544/1167] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 44 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 03 21:40:33.467929 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-43163d7d-80f0-4ee5-914c-81fb87504c67 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:33.468541 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-43163d7d-80f0-4ee5-914c-81fb87504c67 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:33.475611 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-43163d7d-80f0-4ee5-914c-81fb87504c67 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:33.476055 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-43163d7d-80f0-4ee5-914c-81fb87504c67 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:33.476867 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-43163d7d-80f0-4ee5-914c-81fb87504c67 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:33.477292 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-43163d7d-80f0-4ee5-914c-81fb87504c67 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:33.687839 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-43163d7d-80f0-4ee5-914c-81fb87504c67 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:33.695792 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-43163d7d-80f0-4ee5-914c-81fb87504c67 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1521 microversion: 2.1 time: 0.237146 May 03 21:40:33.696573 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 624/1168] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:33 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:34.728494 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-1ac76732-3069-4e1b-96a4-225a83274480 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:34.729329 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-1ac76732-3069-4e1b-96a4-225a83274480 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:34.741753 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1ac76732-3069-4e1b-96a4-225a83274480 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:34.742586 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1ac76732-3069-4e1b-96a4-225a83274480 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:34.743544 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1ac76732-3069-4e1b-96a4-225a83274480 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:34.744733 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-1ac76732-3069-4e1b-96a4-225a83274480 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:34.963281 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-1ac76732-3069-4e1b-96a4-225a83274480 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:34.971761 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-1ac76732-3069-4e1b-96a4-225a83274480 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1577 microversion: 2.1 time: 0.262818 May 03 21:40:34.972393 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 545/1169] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:34 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1577 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:35.994987 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-10f5e5cf-742c-484e-ad2d-0839c52c54a8 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:35.995622 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-10f5e5cf-742c-484e-ad2d-0839c52c54a8 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:36.003817 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-10f5e5cf-742c-484e-ad2d-0839c52c54a8 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:36.004266 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-10f5e5cf-742c-484e-ad2d-0839c52c54a8 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:36.005065 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-10f5e5cf-742c-484e-ad2d-0839c52c54a8 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:36.005503 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-10f5e5cf-742c-484e-ad2d-0839c52c54a8 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:36.212753 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-10f5e5cf-742c-484e-ad2d-0839c52c54a8 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:36.220877 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-10f5e5cf-742c-484e-ad2d-0839c52c54a8 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1577 microversion: 2.1 time: 0.235151 May 03 21:40:36.221952 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 625/1170] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:35 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1577 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:37.243118 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-a220f476-56c9-4e7e-ad50-f29169e77946 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:37.243813 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-a220f476-56c9-4e7e-ad50-f29169e77946 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:37.252051 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a220f476-56c9-4e7e-ad50-f29169e77946 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:37.252534 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a220f476-56c9-4e7e-ad50-f29169e77946 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:37.253300 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a220f476-56c9-4e7e-ad50-f29169e77946 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:37.253738 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-a220f476-56c9-4e7e-ad50-f29169e77946 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:37.459368 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-a220f476-56c9-4e7e-ad50-f29169e77946 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:37.467675 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-a220f476-56c9-4e7e-ad50-f29169e77946 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1577 microversion: 2.1 time: 0.233557 May 03 21:40:37.468199 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 546/1171] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:37 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1577 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:38.491813 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-fc03df33-b10c-4a3b-a03f-e97d5ef67ee4 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:38.492403 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-fc03df33-b10c-4a3b-a03f-e97d5ef67ee4 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:38.500725 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fc03df33-b10c-4a3b-a03f-e97d5ef67ee4 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:38.501167 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fc03df33-b10c-4a3b-a03f-e97d5ef67ee4 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:38.501933 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fc03df33-b10c-4a3b-a03f-e97d5ef67ee4 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:38.502350 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fc03df33-b10c-4a3b-a03f-e97d5ef67ee4 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:38.789174 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-fc03df33-b10c-4a3b-a03f-e97d5ef67ee4 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:38.797686 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-fc03df33-b10c-4a3b-a03f-e97d5ef67ee4 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1577 microversion: 2.1 time: 0.314870 May 03 21:40:38.798216 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 626/1172] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:38 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1577 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:39.819708 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-50c5f056-efa4-4a60-a8da-87d322eac0e2 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:39.820354 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-50c5f056-efa4-4a60-a8da-87d322eac0e2 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:39.828149 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-50c5f056-efa4-4a60-a8da-87d322eac0e2 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:39.828816 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-50c5f056-efa4-4a60-a8da-87d322eac0e2 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:39.829629 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-50c5f056-efa4-4a60-a8da-87d322eac0e2 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:39.830060 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-50c5f056-efa4-4a60-a8da-87d322eac0e2 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:40.030883 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-50c5f056-efa4-4a60-a8da-87d322eac0e2 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:40.039268 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-50c5f056-efa4-4a60-a8da-87d322eac0e2 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1577 microversion: 2.1 time: 0.228554 May 03 21:40:40.042015 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 547/1173] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:39 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1577 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:41.061314 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-cfbd1438-51da-4067-887c-f764d09205b7 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:41.061962 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-cfbd1438-51da-4067-887c-f764d09205b7 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:41.069286 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cfbd1438-51da-4067-887c-f764d09205b7 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:41.069719 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cfbd1438-51da-4067-887c-f764d09205b7 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:41.070486 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cfbd1438-51da-4067-887c-f764d09205b7 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:41.070915 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-cfbd1438-51da-4067-887c-f764d09205b7 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:41.271980 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-cfbd1438-51da-4067-887c-f764d09205b7 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:41.280641 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-cfbd1438-51da-4067-887c-f764d09205b7 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1577 microversion: 2.1 time: 0.228353 May 03 21:40:41.281175 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 627/1174] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:41 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1577 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:42.303480 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-11bc8051-e707-4c35-bd8f-69302f884e5e tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:42.304069 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-11bc8051-e707-4c35-bd8f-69302f884e5e tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:42.311652 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-11bc8051-e707-4c35-bd8f-69302f884e5e tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:42.312101 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-11bc8051-e707-4c35-bd8f-69302f884e5e tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:42.312904 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-11bc8051-e707-4c35-bd8f-69302f884e5e tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:42.313337 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-11bc8051-e707-4c35-bd8f-69302f884e5e tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:42.522773 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-11bc8051-e707-4c35-bd8f-69302f884e5e tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:42.531851 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-11bc8051-e707-4c35-bd8f-69302f884e5e tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1577 microversion: 2.1 time: 0.238091 May 03 21:40:42.532400 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 548/1175] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:42 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1577 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:43.555387 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-1e5094c7-1837-4454-b92c-7d713b451b9f tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:43.555988 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-1e5094c7-1837-4454-b92c-7d713b451b9f tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:43.563969 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-1e5094c7-1837-4454-b92c-7d713b451b9f tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:43.564414 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-1e5094c7-1837-4454-b92c-7d713b451b9f tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:43.565202 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-1e5094c7-1837-4454-b92c-7d713b451b9f tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:43.565632 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-1e5094c7-1837-4454-b92c-7d713b451b9f tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:43.776294 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-1e5094c7-1837-4454-b92c-7d713b451b9f tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:43.785195 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-1e5094c7-1837-4454-b92c-7d713b451b9f tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1577 microversion: 2.1 time: 0.238937 May 03 21:40:43.785728 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 628/1176] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:43 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1577 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:44.717701 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-276b5f26-15ac-4265-8e3d-c4a824ddb638 req-a9409b4e-0c48-4725-bc94-d55cc5c4b362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f20570e8-6f8e-4837-9fe7-10002cea7cea", "name": "network-vif-plugged", "status": "completed", "tag": "b0b6b891-8700-4c78-8b4a-550162963c94"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:40:44.723933 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:40:44.723933 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:40:44.732747 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-276b5f26-15ac-4265-8e3d-c4a824ddb638 req-a9409b4e-0c48-4725-bc94-d55cc5c4b362 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:44.733214 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-276b5f26-15ac-4265-8e3d-c4a824ddb638 req-a9409b4e-0c48-4725-bc94-d55cc5c4b362 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:44.748877 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-276b5f26-15ac-4265-8e3d-c4a824ddb638 req-a9409b4e-0c48-4725-bc94-d55cc5c4b362 service nova] Creating event network-vif-plugged:b0b6b891-8700-4c78-8b4a-550162963c94 for instance f20570e8-6f8e-4837-9fe7-10002cea7cea on hv-cinder-84037 May 03 21:40:44.753615 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-276b5f26-15ac-4265-8e3d-c4a824ddb638 req-a9409b4e-0c48-4725-bc94-d55cc5c4b362 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045459 May 03 21:40:44.754185 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 549/1177] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:40:44.810834 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-855bf91d-c301-4b88-ae8a-7e6381e695f7 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:44.811558 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-855bf91d-c301-4b88-ae8a-7e6381e695f7 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:44.819666 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-855bf91d-c301-4b88-ae8a-7e6381e695f7 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:44.820149 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-855bf91d-c301-4b88-ae8a-7e6381e695f7 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:44.820975 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-855bf91d-c301-4b88-ae8a-7e6381e695f7 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:44.821453 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-855bf91d-c301-4b88-ae8a-7e6381e695f7 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:45.033001 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-855bf91d-c301-4b88-ae8a-7e6381e695f7 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:45.041200 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-855bf91d-c301-4b88-ae8a-7e6381e695f7 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1577 microversion: 2.1 time: 0.241501 May 03 21:40:45.041738 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 629/1178] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:44 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1577 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:46.064774 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-b92d8309-b77f-4172-a671-7bbb0c2bf31f tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:46.065592 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-b92d8309-b77f-4172-a671-7bbb0c2bf31f tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:46.073158 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b92d8309-b77f-4172-a671-7bbb0c2bf31f tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:46.073616 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b92d8309-b77f-4172-a671-7bbb0c2bf31f tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:46.074396 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b92d8309-b77f-4172-a671-7bbb0c2bf31f tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:46.074832 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b92d8309-b77f-4172-a671-7bbb0c2bf31f tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:46.295437 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-b92d8309-b77f-4172-a671-7bbb0c2bf31f tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:46.305149 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-b92d8309-b77f-4172-a671-7bbb0c2bf31f tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1577 microversion: 2.1 time: 0.250587 May 03 21:40:46.305694 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 550/1179] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:46 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1577 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:40:47.328848 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-54fd730e-ac01-4b4c-b6af-023993f62ae6 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:40:47.329452 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-54fd730e-ac01-4b4c-b6af-023993f62ae6 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:40:47.336706 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-54fd730e-ac01-4b4c-b6af-023993f62ae6 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:47.337150 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-54fd730e-ac01-4b4c-b6af-023993f62ae6 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:47.337906 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-54fd730e-ac01-4b4c-b6af-023993f62ae6 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:40:47.338332 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-54fd730e-ac01-4b4c-b6af-023993f62ae6 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:40:47.539860 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-54fd730e-ac01-4b4c-b6af-023993f62ae6 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:40:47.548081 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-54fd730e-ac01-4b4c-b6af-023993f62ae6 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1564 microversion: 2.1 time: 0.228756 May 03 21:40:47.548712 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 630/1180] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:40:47 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1564 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:42:00.507511 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-75d04dbd-43c8-4f49-9790-03b57f4dfe52 req-e61060fc-723e-464f-8778-1295ddfb5158 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cea317da-5aeb-47d0-a20a-17f516ce9eb4", "tag": "863dbad0-54f3-4bbe-8e38-c7eb9fe7f31b"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:42:00.514468 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-b589d44b-21c3-4159-90ba-8784aeadc783 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:42:00.514468 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-b589d44b-21c3-4159-90ba-8784aeadc783 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: cea317da-5aeb-47d0-a20a-17f516ce9eb4] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:42:00.521755 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:42:00.521755 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:42:00.534154 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b589d44b-21c3-4159-90ba-8784aeadc783 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:00.536727 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b589d44b-21c3-4159-90ba-8784aeadc783 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:00.536727 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b589d44b-21c3-4159-90ba-8784aeadc783 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:00.536727 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-b589d44b-21c3-4159-90ba-8784aeadc783 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:00.550627 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-75d04dbd-43c8-4f49-9790-03b57f4dfe52 req-e61060fc-723e-464f-8778-1295ddfb5158 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:00.551075 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-75d04dbd-43c8-4f49-9790-03b57f4dfe52 req-e61060fc-723e-464f-8778-1295ddfb5158 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:00.574399 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-75d04dbd-43c8-4f49-9790-03b57f4dfe52 req-e61060fc-723e-464f-8778-1295ddfb5158 service nova] Creating event network-changed:863dbad0-54f3-4bbe-8e38-c7eb9fe7f31b for instance cea317da-5aeb-47d0-a20a-17f516ce9eb4 on hv-cinder-84037 May 03 21:42:00.581435 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-75d04dbd-43c8-4f49-9790-03b57f4dfe52 req-e61060fc-723e-464f-8778-1295ddfb5158 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093701 May 03 21:42:00.582899 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 631/1181] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:42:00.612649 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-b589d44b-21c3-4159-90ba-8784aeadc783 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: cea317da-5aeb-47d0-a20a-17f516ce9eb4] Going to try to terminate instance {{(pid=97831) delete /opt/stack/nova/nova/compute/api.py:2559}} May 03 21:42:00.881233 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-b589d44b-21c3-4159-90ba-8784aeadc783 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4" status: 204 len: 0 microversion: 2.1 time: 0.394722 May 03 21:42:00.885734 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 551/1182] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 3 21:42:00 2022] DELETE /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 03 21:42:00.897649 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-72bc814a-42de-42ce-b639-90d6f9ed83d7 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:42:00.898254 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-72bc814a-42de-42ce-b639-90d6f9ed83d7 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: cea317da-5aeb-47d0-a20a-17f516ce9eb4] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:42:00.906333 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-72bc814a-42de-42ce-b639-90d6f9ed83d7 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:00.906798 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-72bc814a-42de-42ce-b639-90d6f9ed83d7 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:00.907590 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-72bc814a-42de-42ce-b639-90d6f9ed83d7 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:00.908042 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-72bc814a-42de-42ce-b639-90d6f9ed83d7 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:01.216984 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-72bc814a-42de-42ce-b639-90d6f9ed83d7 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:42:01.226454 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-72bc814a-42de-42ce-b639-90d6f9ed83d7 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4" status: 200 len: 1578 microversion: 2.1 time: 0.339546 May 03 21:42:01.232225 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 632/1183] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:42:00 2022] GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4 => generated 1578 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:42:02.253241 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-06c095e6-98ae-4b2e-bd97-46f997bceb93 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:42:02.253867 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-06c095e6-98ae-4b2e-bd97-46f997bceb93 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: cea317da-5aeb-47d0-a20a-17f516ce9eb4] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:42:02.261771 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-06c095e6-98ae-4b2e-bd97-46f997bceb93 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:02.262138 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-06c095e6-98ae-4b2e-bd97-46f997bceb93 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:02.262887 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-06c095e6-98ae-4b2e-bd97-46f997bceb93 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:02.263306 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-06c095e6-98ae-4b2e-bd97-46f997bceb93 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:02.534355 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-06c095e6-98ae-4b2e-bd97-46f997bceb93 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:42:02.547750 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-06c095e6-98ae-4b2e-bd97-46f997bceb93 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4" status: 200 len: 1578 microversion: 2.1 time: 0.302642 May 03 21:42:02.547750 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 552/1184] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:42:02 2022] GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4 => generated 1578 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:42:03.486683 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-19c70063-9f8c-4c2d-b702-9385fb401d23 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:42:03.487874 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-19c70063-9f8c-4c2d-b702-9385fb401d23 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:42:03.495107 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-822517da-4f2c-4886-9597-ce04e60f4034 req-bc55db96-067b-4600-b869-f43a57251b39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f20570e8-6f8e-4837-9fe7-10002cea7cea", "tag": "b0b6b891-8700-4c78-8b4a-550162963c94"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:42:03.496386 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-19c70063-9f8c-4c2d-b702-9385fb401d23 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:03.497097 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-19c70063-9f8c-4c2d-b702-9385fb401d23 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:03.497952 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-19c70063-9f8c-4c2d-b702-9385fb401d23 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:03.498730 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-19c70063-9f8c-4c2d-b702-9385fb401d23 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:03.509975 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:42:03.509975 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:42:03.520509 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-822517da-4f2c-4886-9597-ce04e60f4034 req-bc55db96-067b-4600-b869-f43a57251b39 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:03.520946 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-822517da-4f2c-4886-9597-ce04e60f4034 req-bc55db96-067b-4600-b869-f43a57251b39 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:03.541359 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-822517da-4f2c-4886-9597-ce04e60f4034 req-bc55db96-067b-4600-b869-f43a57251b39 service nova] Creating event network-changed:b0b6b891-8700-4c78-8b4a-550162963c94 for instance f20570e8-6f8e-4837-9fe7-10002cea7cea on hv-cinder-84037 May 03 21:42:03.551073 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-822517da-4f2c-4886-9597-ce04e60f4034 req-bc55db96-067b-4600-b869-f43a57251b39 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069145 May 03 21:42:03.551859 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 553/1185] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:42:03.576332 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-92469bff-5057-43a4-a638-35dabeffcf2f tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:42:03.576332 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-92469bff-5057-43a4-a638-35dabeffcf2f tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: cea317da-5aeb-47d0-a20a-17f516ce9eb4] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:42:03.583841 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-19c70063-9f8c-4c2d-b702-9385fb401d23 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Going to try to terminate instance {{(pid=97832) delete /opt/stack/nova/nova/compute/api.py:2559}} May 03 21:42:03.595128 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-92469bff-5057-43a4-a638-35dabeffcf2f tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:03.601613 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-92469bff-5057-43a4-a638-35dabeffcf2f tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:03.601613 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-92469bff-5057-43a4-a638-35dabeffcf2f tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:03.601613 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-92469bff-5057-43a4-a638-35dabeffcf2f tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:03.784253 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-92469bff-5057-43a4-a638-35dabeffcf2f tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:42:03.797876 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-92469bff-5057-43a4-a638-35dabeffcf2f tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4" status: 200 len: 1391 microversion: 2.1 time: 0.231684 May 03 21:42:03.807274 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 554/1186] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:42:03 2022] GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4 => generated 1391 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 03 21:42:03.944716 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-19c70063-9f8c-4c2d-b702-9385fb401d23 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 204 len: 0 microversion: 2.1 time: 0.468246 May 03 21:42:03.949541 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 633/1187] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 3 21:42:03 2022] DELETE /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 03 21:42:03.961862 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-fd171b8a-708c-48c6-9286-08b465be3554 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:42:03.962462 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-fd171b8a-708c-48c6-9286-08b465be3554 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:42:03.971110 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fd171b8a-708c-48c6-9286-08b465be3554 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:03.971556 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fd171b8a-708c-48c6-9286-08b465be3554 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:03.972337 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fd171b8a-708c-48c6-9286-08b465be3554 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:03.972801 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-fd171b8a-708c-48c6-9286-08b465be3554 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:04.534109 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-fd171b8a-708c-48c6-9286-08b465be3554 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:42:04.543148 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-fd171b8a-708c-48c6-9286-08b465be3554 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1570 microversion: 2.1 time: 0.591862 May 03 21:42:04.543943 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 555/1188] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:42:03 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1570 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:42:04.822635 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-fbbf7187-59e4-47ff-b267-5c4f1e2081da tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:42:04.828720 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-fbbf7187-59e4-47ff-b267-5c4f1e2081da tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: cea317da-5aeb-47d0-a20a-17f516ce9eb4] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:42:04.831929 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fbbf7187-59e4-47ff-b267-5c4f1e2081da tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:04.832380 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fbbf7187-59e4-47ff-b267-5c4f1e2081da tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:04.833374 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fbbf7187-59e4-47ff-b267-5c4f1e2081da tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:04.833926 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-fbbf7187-59e4-47ff-b267-5c4f1e2081da tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:04.967667 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-fbbf7187-59e4-47ff-b267-5c4f1e2081da tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:42:04.976420 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-fbbf7187-59e4-47ff-b267-5c4f1e2081da tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4" status: 200 len: 1225 microversion: 2.1 time: 0.165077 May 03 21:42:04.976978 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 634/1189] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:42:04 2022] GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4 => generated 1225 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:42:05.568323 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-286b2e27-813d-4003-9b26-15def47aebb8 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:42:05.569178 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-286b2e27-813d-4003-9b26-15def47aebb8 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:42:05.574635 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-3b557040-0966-40ca-a9dc-c56afbe2efd7 req-6059e6ef-33e3-4a44-878b-8eceb15a7c0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cea317da-5aeb-47d0-a20a-17f516ce9eb4", "name": "network-vif-deleted", "tag": "863dbad0-54f3-4bbe-8e38-c7eb9fe7f31b"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:42:05.579231 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-286b2e27-813d-4003-9b26-15def47aebb8 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:05.579896 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-286b2e27-813d-4003-9b26-15def47aebb8 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:05.580843 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-286b2e27-813d-4003-9b26-15def47aebb8 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:05.581387 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-286b2e27-813d-4003-9b26-15def47aebb8 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:05.581604 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:42:05.581604 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:42:05.589805 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-3b557040-0966-40ca-a9dc-c56afbe2efd7 req-6059e6ef-33e3-4a44-878b-8eceb15a7c0d service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:05.590244 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-3b557040-0966-40ca-a9dc-c56afbe2efd7 req-6059e6ef-33e3-4a44-878b-8eceb15a7c0d service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:05.609215 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-3b557040-0966-40ca-a9dc-c56afbe2efd7 req-6059e6ef-33e3-4a44-878b-8eceb15a7c0d service nova] Creating event network-vif-deleted:863dbad0-54f3-4bbe-8e38-c7eb9fe7f31b for instance cea317da-5aeb-47d0-a20a-17f516ce9eb4 on hv-cinder-84037 May 03 21:42:05.615808 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-3b557040-0966-40ca-a9dc-c56afbe2efd7 req-6059e6ef-33e3-4a44-878b-8eceb15a7c0d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052390 May 03 21:42:05.616603 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 635/1190] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:42:05.959841 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-286b2e27-813d-4003-9b26-15def47aebb8 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:42:05.969927 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-286b2e27-813d-4003-9b26-15def47aebb8 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1452 microversion: 2.1 time: 0.411781 May 03 21:42:05.971913 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 556/1191] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:42:05 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1452 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:42:06.000916 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-9730a229-69e7-4691-902d-70cfdfb50e7d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:42:06.001706 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-9730a229-69e7-4691-902d-70cfdfb50e7d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: cea317da-5aeb-47d0-a20a-17f516ce9eb4] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:42:06.009557 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9730a229-69e7-4691-902d-70cfdfb50e7d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:06.010055 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9730a229-69e7-4691-902d-70cfdfb50e7d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:06.010836 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9730a229-69e7-4691-902d-70cfdfb50e7d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:06.011274 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-9730a229-69e7-4691-902d-70cfdfb50e7d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:06.064337 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.wsgi [None req-9730a229-69e7-4691-902d-70cfdfb50e7d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] HTTP exception thrown: Instance cea317da-5aeb-47d0-a20a-17f516ce9eb4 could not be found. May 03 21:42:06.064987 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-9730a229-69e7-4691-902d-70cfdfb50e7d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Returning 404 to user: Instance cea317da-5aeb-47d0-a20a-17f516ce9eb4 could not be found. {{(pid=97832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:42:06.065817 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-9730a229-69e7-4691-902d-70cfdfb50e7d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4" status: 404 len: 111 microversion: 2.1 time: 0.075200 May 03 21:42:06.067508 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 636/1192] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:42:05 2022] GET /compute/v2.1/servers/cea317da-5aeb-47d0-a20a-17f516ce9eb4 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 21:42:06.995169 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-ec5f9d05-fd79-486d-8855-7af4cd5930b2 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:42:06.995786 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-ec5f9d05-fd79-486d-8855-7af4cd5930b2 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:42:07.003668 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ec5f9d05-fd79-486d-8855-7af4cd5930b2 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:07.004118 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ec5f9d05-fd79-486d-8855-7af4cd5930b2 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:07.004975 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ec5f9d05-fd79-486d-8855-7af4cd5930b2 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:07.005411 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-ec5f9d05-fd79-486d-8855-7af4cd5930b2 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:07.215735 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-ec5f9d05-fd79-486d-8855-7af4cd5930b2 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:42:07.224282 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-ec5f9d05-fd79-486d-8855-7af4cd5930b2 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1384 microversion: 2.1 time: 0.238626 May 03 21:42:07.224847 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 557/1193] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:42:06 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1384 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:42:07.635324 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-66333ad8-f3c7-491e-8bda-264b0c0d7b04 req-91bc8b81-1bcf-4182-9f28-2b52bc1ac314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f20570e8-6f8e-4837-9fe7-10002cea7cea", "name": "network-vif-deleted", "tag": "b0b6b891-8700-4c78-8b4a-550162963c94"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:42:07.642015 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:42:07.642015 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:42:07.650412 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-66333ad8-f3c7-491e-8bda-264b0c0d7b04 req-91bc8b81-1bcf-4182-9f28-2b52bc1ac314 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:07.654824 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-66333ad8-f3c7-491e-8bda-264b0c0d7b04 req-91bc8b81-1bcf-4182-9f28-2b52bc1ac314 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:07.679058 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-66333ad8-f3c7-491e-8bda-264b0c0d7b04 req-91bc8b81-1bcf-4182-9f28-2b52bc1ac314 service nova] Creating event network-vif-deleted:b0b6b891-8700-4c78-8b4a-550162963c94 for instance f20570e8-6f8e-4837-9fe7-10002cea7cea on hv-cinder-84037 May 03 21:42:07.684277 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-66333ad8-f3c7-491e-8bda-264b0c0d7b04 req-91bc8b81-1bcf-4182-9f28-2b52bc1ac314 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058468 May 03 21:42:07.686218 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 637/1194] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:42:08.247023 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-f0147a3c-e3d5-4e3f-84d4-d7999b97cdde tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:42:08.247574 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-f0147a3c-e3d5-4e3f-84d4-d7999b97cdde tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:42:08.255080 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f0147a3c-e3d5-4e3f-84d4-d7999b97cdde tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:08.255527 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f0147a3c-e3d5-4e3f-84d4-d7999b97cdde tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:08.256299 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f0147a3c-e3d5-4e3f-84d4-d7999b97cdde tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:08.256770 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f0147a3c-e3d5-4e3f-84d4-d7999b97cdde tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:08.330731 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f0147a3c-e3d5-4e3f-84d4-d7999b97cdde tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:08.331192 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f0147a3c-e3d5-4e3f-84d4-d7999b97cdde tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:08.331634 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.objects.instance [None req-f0147a3c-e3d5-4e3f-84d4-d7999b97cdde tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lazy-loading 'fault' on Instance uuid f20570e8-6f8e-4837-9fe7-10002cea7cea {{(pid=97831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 03 21:42:08.404029 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-f0147a3c-e3d5-4e3f-84d4-d7999b97cdde tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7706b8821948b6bbfe86a3805f7461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9727df4a44eaaa12b84e3f0df0b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:42:08.413128 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-f0147a3c-e3d5-4e3f-84d4-d7999b97cdde tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 200 len: 1225 microversion: 2.1 time: 0.175542 May 03 21:42:08.413673 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 558/1195] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:42:08 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 1225 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:42:09.437851 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-23e72c21-c734-44fd-8273-81053ebcbc08 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:42:09.438521 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-23e72c21-c734-44fd-8273-81053ebcbc08 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] [instance: f20570e8-6f8e-4837-9fe7-10002cea7cea] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:42:09.446050 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-23e72c21-c734-44fd-8273-81053ebcbc08 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:09.446488 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-23e72c21-c734-44fd-8273-81053ebcbc08 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:09.447248 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-23e72c21-c734-44fd-8273-81053ebcbc08 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:09.447674 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-23e72c21-c734-44fd-8273-81053ebcbc08 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:09.499713 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.wsgi [None req-23e72c21-c734-44fd-8273-81053ebcbc08 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] HTTP exception thrown: Instance f20570e8-6f8e-4837-9fe7-10002cea7cea could not be found. May 03 21:42:09.500842 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-23e72c21-c734-44fd-8273-81053ebcbc08 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Returning 404 to user: Instance f20570e8-6f8e-4837-9fe7-10002cea7cea could not be found. {{(pid=97832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:42:09.501565 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-23e72c21-c734-44fd-8273-81053ebcbc08 tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea" status: 404 len: 111 microversion: 2.1 time: 0.074009 May 03 21:42:09.502126 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 638/1196] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:42:09 2022] GET /compute/v2.1/servers/f20570e8-6f8e-4837-9fe7-10002cea7cea => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 21:42:09.905619 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-952aab05-187f-45fb-816b-ed9673d818ce tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] Calling method '.version_select at 0x7fc84cf21dc0>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:42:10.004438 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-952aab05-187f-45fb-816b-ed9673d818ce tempest-TestShelveInstance-1775851064 tempest-TestShelveInstance-1775851064-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1858174847" status: 202 len: 0 microversion: 2.1 time: 0.107880 May 03 21:42:10.005024 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 559/1197] 10.222.0.48 () {58 vars in 1253 bytes} [Tue May 3 21:42:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1858174847 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 03 21:42:10.407994 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-28a6e321-7a77-4e1a-9129-6658548fabf2 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:42:10.409098 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-28a6e321-7a77-4e1a-9129-6658548fabf2 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 5d20cd93-7f61-4f7b-9488-b8e8a56c24d8] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:42:10.416712 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [req-8955f814-ed09-45f5-ba85-b4813c259dac req-57e95296-22b0-431f-b7f4-aa217c895936 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d20cd93-7f61-4f7b-9488-b8e8a56c24d8", "tag": "861debb4-c679-41ef-af2d-3ffdd7122e86"}]} {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:42:10.418770 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-28a6e321-7a77-4e1a-9129-6658548fabf2 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:10.419492 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-28a6e321-7a77-4e1a-9129-6658548fabf2 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:10.420537 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-28a6e321-7a77-4e1a-9129-6658548fabf2 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:10.421864 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-28a6e321-7a77-4e1a-9129-6658548fabf2 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:10.425367 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:42:10.425367 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: warnings.warn(msg) May 03 21:42:10.439162 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-8955f814-ed09-45f5-ba85-b4813c259dac req-57e95296-22b0-431f-b7f4-aa217c895936 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:10.439892 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [req-8955f814-ed09-45f5-ba85-b4813c259dac req-57e95296-22b0-431f-b7f4-aa217c895936 service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:10.458039 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.compute.server_external_events [req-8955f814-ed09-45f5-ba85-b4813c259dac req-57e95296-22b0-431f-b7f4-aa217c895936 service nova] Creating event network-changed:861debb4-c679-41ef-af2d-3ffdd7122e86 for instance 5d20cd93-7f61-4f7b-9488-b8e8a56c24d8 on hv-cinder-84037 May 03 21:42:10.464066 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [req-8955f814-ed09-45f5-ba85-b4813c259dac req-57e95296-22b0-431f-b7f4-aa217c895936 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059230 May 03 21:42:10.465233 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 560/1198] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 03 21:42:10.506687 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-28a6e321-7a77-4e1a-9129-6658548fabf2 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 5d20cd93-7f61-4f7b-9488-b8e8a56c24d8] Going to try to terminate instance {{(pid=97832) delete /opt/stack/nova/nova/compute/api.py:2559}} May 03 21:42:10.749394 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-28a6e321-7a77-4e1a-9129-6658548fabf2 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8" status: 204 len: 0 microversion: 2.1 time: 0.351865 May 03 21:42:10.750484 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 639/1199] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 3 21:42:10 2022] DELETE /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 03 21:42:10.766467 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-154be87a-ad87-4aab-a9f9-c866a4c671d3 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:42:10.808928 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-154be87a-ad87-4aab-a9f9-c866a4c671d3 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 5d20cd93-7f61-4f7b-9488-b8e8a56c24d8] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:42:10.808928 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-154be87a-ad87-4aab-a9f9-c866a4c671d3 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:10.808928 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-154be87a-ad87-4aab-a9f9-c866a4c671d3 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:10.808928 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-154be87a-ad87-4aab-a9f9-c866a4c671d3 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:10.809635 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-154be87a-ad87-4aab-a9f9-c866a4c671d3 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:11.581348 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-154be87a-ad87-4aab-a9f9-c866a4c671d3 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:42:11.589859 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-154be87a-ad87-4aab-a9f9-c866a4c671d3 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8" status: 200 len: 1577 microversion: 2.1 time: 0.834687 May 03 21:42:11.590515 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 561/1200] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:42:10 2022] GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8 => generated 1577 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:42:12.614405 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-1e7b65ce-a1f8-4ca2-86fb-cf9c35d25989 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:42:12.615389 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-1e7b65ce-a1f8-4ca2-86fb-cf9c35d25989 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 5d20cd93-7f61-4f7b-9488-b8e8a56c24d8] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:42:12.624251 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-1e7b65ce-a1f8-4ca2-86fb-cf9c35d25989 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:12.625571 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-1e7b65ce-a1f8-4ca2-86fb-cf9c35d25989 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:12.626385 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-1e7b65ce-a1f8-4ca2-86fb-cf9c35d25989 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:12.626848 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-1e7b65ce-a1f8-4ca2-86fb-cf9c35d25989 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:12.888538 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.policy [None req-1e7b65ce-a1f8-4ca2-86fb-cf9c35d25989 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97832) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:42:12.897336 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-1e7b65ce-a1f8-4ca2-86fb-cf9c35d25989 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8" status: 200 len: 1459 microversion: 2.1 time: 0.293914 May 03 21:42:12.897911 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 640/1201] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:42:12 2022] GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8 => generated 1459 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:42:13.922849 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-4d31679d-2500-428e-aaf5-d8fdac938ef1 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:42:13.922849 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-4d31679d-2500-428e-aaf5-d8fdac938ef1 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 5d20cd93-7f61-4f7b-9488-b8e8a56c24d8] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:42:13.931102 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4d31679d-2500-428e-aaf5-d8fdac938ef1 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:13.931561 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4d31679d-2500-428e-aaf5-d8fdac938ef1 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:13.932342 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4d31679d-2500-428e-aaf5-d8fdac938ef1 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:13.932797 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-4d31679d-2500-428e-aaf5-d8fdac938ef1 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:14.174541 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [req-c1dacb79-34be-45a3-9d1b-50e456d64953 req-0219e2a4-ce9b-4824-a520-f79326cd080b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d20cd93-7f61-4f7b-9488-b8e8a56c24d8", "name": "network-vif-deleted", "tag": "861debb4-c679-41ef-af2d-3ffdd7122e86"}]} {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 03 21:42:14.180949 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 21:42:14.180949 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: warnings.warn(msg) May 03 21:42:14.184842 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-4d31679d-2500-428e-aaf5-d8fdac938ef1 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:42:14.191015 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-c1dacb79-34be-45a3-9d1b-50e456d64953 req-0219e2a4-ce9b-4824-a520-f79326cd080b service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:14.195028 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [req-c1dacb79-34be-45a3-9d1b-50e456d64953 req-0219e2a4-ce9b-4824-a520-f79326cd080b service nova] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:14.195195 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-4d31679d-2500-428e-aaf5-d8fdac938ef1 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8" status: 200 len: 1391 microversion: 2.1 time: 0.282943 May 03 21:42:14.195410 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 562/1202] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:42:13 2022] GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8 => generated 1391 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:42:14.218516 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.compute.server_external_events [req-c1dacb79-34be-45a3-9d1b-50e456d64953 req-0219e2a4-ce9b-4824-a520-f79326cd080b service nova] Creating event network-vif-deleted:861debb4-c679-41ef-af2d-3ffdd7122e86 for instance 5d20cd93-7f61-4f7b-9488-b8e8a56c24d8 on hv-cinder-84037 May 03 21:42:14.223101 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [req-c1dacb79-34be-45a3-9d1b-50e456d64953 req-0219e2a4-ce9b-4824-a520-f79326cd080b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057781 May 03 21:42:14.223785 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 641/1203] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 3 21:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 03 21:42:15.217659 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-f59833e3-69f1-4688-be10-2a3aa130a3f9 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:42:15.218367 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-f59833e3-69f1-4688-be10-2a3aa130a3f9 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 5d20cd93-7f61-4f7b-9488-b8e8a56c24d8] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:42:15.226780 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f59833e3-69f1-4688-be10-2a3aa130a3f9 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:15.227523 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f59833e3-69f1-4688-be10-2a3aa130a3f9 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:15.228568 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f59833e3-69f1-4688-be10-2a3aa130a3f9 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:15.229245 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f59833e3-69f1-4688-be10-2a3aa130a3f9 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:15.308035 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f59833e3-69f1-4688-be10-2a3aa130a3f9 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:15.308632 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-f59833e3-69f1-4688-be10-2a3aa130a3f9 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:15.309266 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.objects.instance [None req-f59833e3-69f1-4688-be10-2a3aa130a3f9 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lazy-loading 'fault' on Instance uuid 5d20cd93-7f61-4f7b-9488-b8e8a56c24d8 {{(pid=97831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 03 21:42:15.504553 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.policy [None req-f59833e3-69f1-4688-be10-2a3aa130a3f9 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2873b6c651a94d4992d0debcab8aeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e665d5aad2c24ad7843ca060d41792d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97831) authorize /opt/stack/nova/nova/policy.py:222}} May 03 21:42:15.514838 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-f59833e3-69f1-4688-be10-2a3aa130a3f9 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8" status: 200 len: 1229 microversion: 2.1 time: 0.306005 May 03 21:42:15.525160 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 563/1204] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:42:15 2022] GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8 => generated 1229 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 03 21:42:16.544927 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-e98fc03a-0f9a-443c-a4e0-4374e0baec60 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:42:16.545663 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-e98fc03a-0f9a-443c-a4e0-4374e0baec60 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 5d20cd93-7f61-4f7b-9488-b8e8a56c24d8] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:42:16.554283 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e98fc03a-0f9a-443c-a4e0-4374e0baec60 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:16.554726 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e98fc03a-0f9a-443c-a4e0-4374e0baec60 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:16.555512 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e98fc03a-0f9a-443c-a4e0-4374e0baec60 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:16.555955 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-e98fc03a-0f9a-443c-a4e0-4374e0baec60 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:16.611062 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.wsgi [None req-e98fc03a-0f9a-443c-a4e0-4374e0baec60 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] HTTP exception thrown: Instance 5d20cd93-7f61-4f7b-9488-b8e8a56c24d8 could not be found. May 03 21:42:16.611685 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-e98fc03a-0f9a-443c-a4e0-4374e0baec60 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Returning 404 to user: Instance 5d20cd93-7f61-4f7b-9488-b8e8a56c24d8 could not be found. {{(pid=97832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:42:16.612553 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-e98fc03a-0f9a-443c-a4e0-4374e0baec60 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8" status: 404 len: 111 microversion: 2.1 time: 0.078036 May 03 21:42:16.617255 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 642/1205] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:42:16 2022] GET /compute/v2.1/servers/5d20cd93-7f61-4f7b-9488-b8e8a56c24d8 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 03 21:42:17.738294 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-17b779a0-2f8b-4afc-9e07-cd6dc1d9b4fa tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:42:17.738863 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.compute.api [None req-17b779a0-2f8b-4afc-9e07-cd6dc1d9b4fa tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 4e3930f0-3a9f-4d20-ae74-434e66c18c46] Fetching instance by UUID {{(pid=97831) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:42:17.746869 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-17b779a0-2f8b-4afc-9e07-cd6dc1d9b4fa tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:17.747324 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-17b779a0-2f8b-4afc-9e07-cd6dc1d9b4fa tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:17.748118 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-17b779a0-2f8b-4afc-9e07-cd6dc1d9b4fa tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:17.748826 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG oslo_concurrency.lockutils [None req-17b779a0-2f8b-4afc-9e07-cd6dc1d9b4fa tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:17.802122 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.wsgi [None req-17b779a0-2f8b-4afc-9e07-cd6dc1d9b4fa tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] HTTP exception thrown: Instance 4e3930f0-3a9f-4d20-ae74-434e66c18c46 could not be found. May 03 21:42:17.803038 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-17b779a0-2f8b-4afc-9e07-cd6dc1d9b4fa tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Returning 404 to user: Instance 4e3930f0-3a9f-4d20-ae74-434e66c18c46 could not be found. {{(pid=97831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:42:17.804077 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-17b779a0-2f8b-4afc-9e07-cd6dc1d9b4fa tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46" status: 404 len: 111 microversion: 2.1 time: 0.077187 May 03 21:42:17.808031 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 564/1206] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 3 21:42:17 2022] DELETE /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 21:42:17.820691 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-c7aa918d-31d6-4b96-8d49-0719648a3b18 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '>' {{(pid=97832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:42:17.822264 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.compute.api [None req-c7aa918d-31d6-4b96-8d49-0719648a3b18 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] [instance: 4e3930f0-3a9f-4d20-ae74-434e66c18c46] Fetching instance by UUID {{(pid=97832) get /opt/stack/nova/nova/compute/api.py:2810}} May 03 21:42:17.835008 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c7aa918d-31d6-4b96-8d49-0719648a3b18 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:17.835595 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c7aa918d-31d6-4b96-8d49-0719648a3b18 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:17.836659 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c7aa918d-31d6-4b96-8d49-0719648a3b18 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 03 21:42:17.837176 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG oslo_concurrency.lockutils [None req-c7aa918d-31d6-4b96-8d49-0719648a3b18 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Lock "ac0acf8d-610e-4c6a-bd6f-66114ecd3ce3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 03 21:42:17.894165 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.wsgi [None req-c7aa918d-31d6-4b96-8d49-0719648a3b18 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] HTTP exception thrown: Instance 4e3930f0-3a9f-4d20-ae74-434e66c18c46 could not be found. May 03 21:42:17.894782 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: DEBUG nova.api.openstack.wsgi [None req-c7aa918d-31d6-4b96-8d49-0719648a3b18 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Returning 404 to user: Instance 4e3930f0-3a9f-4d20-ae74-434e66c18c46 could not be found. {{(pid=97832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} May 03 21:42:17.895630 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: INFO nova.api.openstack.requestlog [None req-c7aa918d-31d6-4b96-8d49-0719648a3b18 tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46" status: 404 len: 111 microversion: 2.1 time: 0.086238 May 03 21:42:17.896468 dv-cinder-840377-1-iscsi devstack@n-api.service[97832]: [pid: 97832|app: 0|req: 643/1207] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 3 21:42:17 2022] GET /compute/v2.1/servers/4e3930f0-3a9f-4d20-ae74-434e66c18c46 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 03 21:42:19.642417 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: DEBUG nova.api.openstack.wsgi [None req-3449fe71-d4a5-42df-8634-a9a27c5daf7d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] Calling method '.version_select at 0x7fc84cf350d0>' {{(pid=97831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 03 21:42:19.773367 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: INFO nova.api.openstack.requestlog [None req-3449fe71-d4a5-42df-8634-a9a27c5daf7d tempest-TestVolumeBootPattern-1074687001 tempest-TestVolumeBootPattern-1074687001-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-103237313" status: 202 len: 0 microversion: 2.1 time: 0.140461 May 03 21:42:19.773942 dv-cinder-840377-1-iscsi devstack@n-api.service[97831]: [pid: 97831|app: 0|req: 565/1208] 10.222.0.48 () {58 vars in 1259 bytes} [Tue May 3 21:42:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-103237313 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)